May 28 15:07:39.923429 ip-10-0-137-0 systemd[1]: Starting Kubernetes Kubelet...
May 28 15:07:40.444147 ip-10-0-137-0 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 15:07:40.444147 ip-10-0-137-0 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 15:07:40.444147 ip-10-0-137-0 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 15:07:40.444147 ip-10-0-137-0 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 15:07:40.444147 ip-10-0-137-0 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 15:07:40.447988 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.447918    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 15:07:40.451868 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451854    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 15:07:40.451868 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451868    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451872    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451875    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451879    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451882    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451886    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451891    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451894    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451897    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451900    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451903    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451905    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451908    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451911    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451913    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451916    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451920    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451924    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451934    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 15:07:40.451937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451937    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451940    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451943    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451946    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451949    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451952    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451955    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451957    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451960    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451962    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451965    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451968    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451970    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451973    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451975    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451977    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451980    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451982    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451985    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451987    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 15:07:40.452414 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451990    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451993    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451996    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.451998    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452001    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452003    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452005    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452008    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452010    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452013    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452029    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452032    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452034    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452036    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452040    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452043    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452045    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452048    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452050    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452053    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 15:07:40.452910 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452056    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452058    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452061    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452063    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452065    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452068    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452070    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452073    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452076    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452079    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452082    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452085    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452087    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452090    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452092    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452095    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452097    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452100    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452102    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452105    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 15:07:40.453413 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452107    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452110    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452112    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452115    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452118    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452120    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452488    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452493    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452497    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452501    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452504    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452507    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452509    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452512    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452515    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452518    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452520    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452523    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452525    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 15:07:40.453882 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452528    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452531    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452534    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452537    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452541    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452544    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452546    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452549    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452551    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452554    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452556    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452559    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452561    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452564    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452566    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452568    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452571    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452574    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452576    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452579    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 15:07:40.454341 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452582    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452584    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452587    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452589    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452592    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452594    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452597    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452599    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452602    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452604    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452607    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452609    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452611    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452614    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452616    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452619    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452622    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452626    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452628    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 15:07:40.454827 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452630    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452633    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452635    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452638    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452640    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452643    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452645    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452647    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452650    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452652    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452656    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452659    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452663    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452666    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452668    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452671    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452674    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452676    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452679    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 15:07:40.455371 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452681    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452683    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452686    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452688    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452691    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452693    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452695    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452698    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452700    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452702    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452705    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452708    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452710    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452713    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.452715    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453581    2562 flags.go:64] FLAG: --address="0.0.0.0"
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453591    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453598    2562 flags.go:64] FLAG: --anonymous-auth="true"
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453602    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453606    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453610    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 15:07:40.455841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453614    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453618    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453622    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453625    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453628    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453632    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453635    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453638    2562 flags.go:64] FLAG: --cgroup-root=""
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453640    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453643    2562 flags.go:64] FLAG: --client-ca-file=""
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453646    2562 flags.go:64] FLAG: --cloud-config=""
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453648    2562 flags.go:64] FLAG: --cloud-provider="external"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453651    2562 flags.go:64] FLAG: --cluster-dns="[]"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453656    2562 flags.go:64] FLAG: --cluster-domain=""
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453659    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453662    2562 flags.go:64] FLAG: --config-dir=""
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453665    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453668    2562 flags.go:64] FLAG: --container-log-max-files="5"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453672    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453675    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453678    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453681    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453684    2562 flags.go:64] FLAG: --contention-profiling="false"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453687    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 15:07:40.456371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453690    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453693    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453696    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453700    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453703    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453706    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453709    2562 flags.go:64] FLAG: --enable-load-reader="false"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453712    2562 flags.go:64] FLAG: --enable-server="true"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453715    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453719    2562 flags.go:64] FLAG: --event-burst="100"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453722    2562 flags.go:64] FLAG: --event-qps="50"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453725    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453728    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453731    2562 flags.go:64] FLAG: --eviction-hard=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453734    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453737    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453740    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453743    2562 flags.go:64] FLAG: --eviction-soft=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453746    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453748    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453751    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453755    2562 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453758    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453761    2562 flags.go:64] FLAG: --fail-swap-on="true"
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453763    2562 flags.go:64] FLAG: --feature-gates=""
May 28 15:07:40.456989 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453767    2562 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453770    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453773    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453776    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453779    2562 flags.go:64] FLAG: --healthz-port="10248"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453782    2562 flags.go:64] FLAG: --help="false"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453785    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-137-0.ec2.internal"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453789    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453792    2562 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453795    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453799    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453802    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453804    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453807    2562 flags.go:64] FLAG: --image-service-endpoint=""
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453810    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453813    2562 flags.go:64] FLAG: --kube-api-burst="100"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453815    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453818    2562 flags.go:64] FLAG: --kube-api-qps="50"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453821    2562 flags.go:64] FLAG: --kube-reserved=""
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453824    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453827    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453830    2562 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453833    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453836    2562 flags.go:64] FLAG: --lock-file=""
May 28 15:07:40.457648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453838    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453841    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453844    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453849    2562 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453852    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453855    2562 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453857    2562 flags.go:64] FLAG: --logging-format="text"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453860    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453863    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453866    2562 flags.go:64] FLAG: --manifest-url=""
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453869    2562 flags.go:64] FLAG: --manifest-url-header=""
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453873    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453876    2562 flags.go:64] FLAG: --max-open-files="1000000"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453881    2562 flags.go:64] FLAG: --max-pods="110"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453884    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453886    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453890    2562 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453893    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453896    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453899    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453902    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453910    2562 flags.go:64] FLAG: --node-status-max-images="50"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453913    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453916    2562 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 15:07:40.458254 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453919    2562 flags.go:64] FLAG: --pod-cidr=""
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453921    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453927    2562 flags.go:64] FLAG: --pod-manifest-path=""
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453930    2562 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453933    2562 flags.go:64] FLAG: --pods-per-core="0"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453936    2562 flags.go:64] FLAG: --port="10250"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453939    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453941    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0da76d33bf6076660"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453944    2562 flags.go:64] FLAG: --qos-reserved=""
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453947    2562 flags.go:64] FLAG: --read-only-port="10255"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453950    2562 flags.go:64] FLAG: --register-node="true"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453953    2562 flags.go:64] FLAG: --register-schedulable="true"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453956    2562 flags.go:64] FLAG: --register-with-taints=""
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453959    2562 flags.go:64] FLAG: --registry-burst="10"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453962    2562 flags.go:64] FLAG: --registry-qps="5"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453965    2562 flags.go:64] FLAG: --reserved-cpus=""
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453967    2562 flags.go:64] FLAG: --reserved-memory=""
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453971    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453974    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453977    2562 flags.go:64] FLAG: --rotate-certificates="false"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453979    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453982    2562 flags.go:64] FLAG: --runonce="false"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453985    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453988    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453991    2562 flags.go:64] FLAG: --seccomp-default="false"
May 28 15:07:40.458820 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453995    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.453997    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454001    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454003    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454006    2562 flags.go:64] FLAG: --storage-driver-password="root"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454009    2562 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454012    2562 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454028    2562 flags.go:64] FLAG: --storage-driver-user="root"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454031    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454035    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454038    2562 flags.go:64] FLAG: --system-cgroups=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454040    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454045    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454048    2562 flags.go:64] FLAG: --tls-cert-file=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454051    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454055    2562 flags.go:64] FLAG: --tls-min-version=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454058    2562 flags.go:64] FLAG: --tls-private-key-file=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454060    2562 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454063    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454066    2562 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454069    2562 flags.go:64] FLAG: --v="2"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454073    2562 flags.go:64] FLAG: --version="false"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454076    2562 flags.go:64] FLAG: --vmodule=""
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454080    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454083    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 15:07:40.459458 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454175    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454178    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454181    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454184    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454187    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454193    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454196    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454199    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454202    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454205    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454208    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454210    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454212    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454215    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454218    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454220    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454223    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454225    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454227    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 15:07:40.460079 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454230    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454232    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454235    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454237    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454240    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454242    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454244    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454247    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454249    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454252    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454254    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454257    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454259    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454261    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454265    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454267    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454269    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454272    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454275    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 15:07:40.460579 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454278    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454280    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454283    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454291    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454294    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454297    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454299    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454302    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454304    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454307    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454309    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454312    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454314    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454317    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454319    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454321    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454324    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454326    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454328    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454331    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 15:07:40.461080 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454333    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454336    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454339    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454342    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454344    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454347    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454349    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454352    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454354    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454357    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454359    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454363    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454365    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454368    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454370    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454374    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454378    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454382    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454385    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 15:07:40.461569 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454388    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454390    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454393    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454395    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454398    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454400    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454402    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454405    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.454407    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.454412    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.461072    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.461086    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461132    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461136    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461139    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461142    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 15:07:40.462040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461146    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461149    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461152    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461155    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461158    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461161    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461164    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461167    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461169    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461172    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461175    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461179    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461182    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461185    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461188    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461191    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461194    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461197    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461199    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461202    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 15:07:40.462456 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461204    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461207    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461209    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461212    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461214    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461216    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461219    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461223    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461225    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461228    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461230    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461235    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461239    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461241    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461244    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461246    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461249    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461252    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461254    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 15:07:40.462937 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461256    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461259    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461261    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461263    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461266    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461269    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461271    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461274    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461278    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461281    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461283    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461286    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461288    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461291    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461293    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461296    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461298    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461300    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461303    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 15:07:40.463423 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461305    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461308    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461311    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461313    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461316    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461318    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461321    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461323    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461326    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461328    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461331    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461333    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461336    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461338    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461340    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461343    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461345    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461347    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461350    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461352    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 15:07:40.463876 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461355    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461358    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461360    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461362    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.461367    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461464    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461468    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461471    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461474    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461477    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461479    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461482    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461485    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461488    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461490    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461493    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 15:07:40.464373 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461496    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461498    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461501    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461503    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461507    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461510    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461513    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461515    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461517    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461520    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461522    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461525    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461527    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461530    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461533    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461535    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461538    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461540    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461543    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461546    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 15:07:40.464763 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461549    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461551    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461553    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461556    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461558    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461561    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461563    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461566    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461568    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461571    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461574    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461576    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461579    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461581    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461584    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461586    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461589    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461591    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461594    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461596    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 15:07:40.465253 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461599    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461601    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461603    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461606    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461608    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461612    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461615    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461618    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461621    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461624    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461627    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461630    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461632    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461635    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461637    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461640    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461642    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461644    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461647    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 15:07:40.465737 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461649    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461651    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461654    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461656    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461659    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461661    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461664    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461666    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461668    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461671    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461673    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461676    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461678    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461681    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461683    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.461685    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 15:07:40.466220 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.461690    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 15:07:40.466593 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.462542    2562 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 15:07:40.466593 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.464896    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 15:07:40.466593 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.465995    2562 server.go:1019] "Starting client certificate rotation"
May 28 15:07:40.466593 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.466048    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 15:07:40.466593 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.466091    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 15:07:40.494436 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.494418    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 15:07:40.508749 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.499925    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 15:07:40.526571 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.526549    2562 log.go:25] "Validated CRI v1 runtime API"
May 28 15:07:40.532577 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.532555    2562 log.go:25] "Validated CRI v1 image API"
May 28 15:07:40.533913 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.533893    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 15:07:40.535648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.535632    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 15:07:40.536622 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.536592    2562 fs.go:135] Filesystem UUIDs: map[26ebfcff-81b4-4256-875d-151a592d2130:/dev/nvme0n1p3 5a6d1791-e0aa-4b6f-9fd4-2f0a31f6b67c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 28 15:07:40.536666 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.536623    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 15:07:40.540698 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.540593    2562 manager.go:217] Machine: {Timestamp:2026-05-28 15:07:40.540126831 +0000 UTC m=+0.473799714 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098971 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27e99d9df0da895db49bdca9817634 SystemUUID:ec27e99d-9df0-da89-5db4-9bdca9817634 BootID:01226393-ba06-489e-b100-c622de2f6975 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:7f:74:f2:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:7f:74:f2:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:48:eb:d5:d3:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 15:07:40.541647 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.541636    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 15:07:40.541743 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.541731    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 15:07:40.545581 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.545556    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 15:07:40.545714 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.545585    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 15:07:40.545765 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.545723    2562 topology_manager.go:138] "Creating topology manager with none policy"
May 28 15:07:40.545765 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.545731    2562 container_manager_linux.go:306] "Creating device plugin manager"
May 28 15:07:40.545765 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.545739    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 15:07:40.547444 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.547434    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 15:07:40.549877 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.549865    2562 state_mem.go:36] "Initialized new in-memory state store"
May 28 15:07:40.550117 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.550107    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 15:07:40.552842 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.552831    2562 kubelet.go:491] "Attempting to sync node with API server"
May 28 15:07:40.552886 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.552851    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 15:07:40.552886 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.552862    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 15:07:40.552886 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.552871    2562 kubelet.go:397] "Adding apiserver pod source"
May 28 15:07:40.552886 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.552879    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 15:07:40.554012 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.554000    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 15:07:40.554072 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.554037    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 15:07:40.560484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.560465    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 15:07:40.561956 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.561941    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-46tdt"
May 28 15:07:40.562789 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.562777    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 15:07:40.563669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563659    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 15:07:40.563704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563674    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 15:07:40.563704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563680    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 15:07:40.563704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563686    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 15:07:40.563704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563694    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 15:07:40.563704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563699    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 15:07:40.563704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563705    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 15:07:40.563851 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563710    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 15:07:40.563851 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563721    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 15:07:40.563851 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563727    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 15:07:40.563851 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.563740    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 15:07:40.564139 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.564130    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 15:07:40.565213 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.565202    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 15:07:40.565213 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.565214    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 15:07:40.567997 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.567972    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 15:07:40.568084 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.568035    2562 server.go:1295] "Started kubelet"
May 28 15:07:40.568147 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.568106    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 15:07:40.568194 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.568162    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 15:07:40.568427 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.568403    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 15:07:40.568665 ip-10-0-137-0 systemd[1]: Started Kubernetes Kubelet.
May 28 15:07:40.569988 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.569847    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 15:07:40.570110 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.569893    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-46tdt"
May 28 15:07:40.570864 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.570842    2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 15:07:40.571834 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.571816    2562 server.go:317] "Adding debug handlers to kubelet server"
May 28 15:07:40.573429 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.573401    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 15:07:40.573526 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.573472    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 15:07:40.581283 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.581264    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 15:07:40.582747 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.582727    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 15:07:40.582845 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.582751    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 15:07:40.583223 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583199    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 15:07:40.583223 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583222    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 15:07:40.583348 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583230    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 15:07:40.583348 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583338    2562 reconstruct.go:97] "Volume reconstruction finished"
May 28 15:07:40.583348 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583347    2562 reconciler.go:26] "Reconciler: start to sync state"
May 28 15:07:40.583472 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583455    2562 factory.go:55] Registering systemd factory
May 28 15:07:40.583472 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583468    2562 factory.go:223] Registration of the systemd container factory successfully
May 28 15:07:40.583772 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583713    2562 factory.go:153] Registering CRI-O factory
May 28 15:07:40.583772 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583728    2562 factory.go:223] Registration of the crio container factory successfully
May 28 15:07:40.583899 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583803    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 15:07:40.583899 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583820    2562 factory.go:103] Registering Raw factory
May 28 15:07:40.583899 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.583833    2562 manager.go:1196] Started watching for new ooms in manager
May 28 15:07:40.584069 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.584035    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:40.584198 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.584185    2562 manager.go:319] Starting recovery of all containers
May 28 15:07:40.585613 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.585592    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 15:07:40.588199 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.588178    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
May 28 15:07:40.588673 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:40.588655    2562 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max: no such device
May 28 15:07:40.593590 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.593576    2562 manager.go:324] Recovery completed
May 28 15:07:40.597501 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.597488    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 15:07:40.599262 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.599248    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
May 28 15:07:40.599332 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.599279    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
May 28 15:07:40.599332 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.599295    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
May 28 15:07:40.599726 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.599712    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 15:07:40.599726 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.599725    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 15:07:40.599823 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.599757    2562 state_mem.go:36] "Initialized new in-memory state store"
May 28 15:07:40.603214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.603202    2562 policy_none.go:49] "None policy: Start"
May 28 15:07:40.603249 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.603219    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 15:07:40.603249 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.603229    2562 state_mem.go:35] "Initializing new in-memory state store"
May 28 15:07:40.641612 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.641598    2562 manager.go:341] "Starting Device Plugin manager"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.641661    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.641674    2562 server.go:85] "Starting device plugin registration server"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.641851    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.641863    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.642462    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.642403    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.642721    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.642723    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:40.669991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.642731    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 15:07:40.691120 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.691092    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 15:07:40.692391 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.692379    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 15:07:40.692477 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.692405    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 15:07:40.692477 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.692421    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 15:07:40.692477 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.692428    2562 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 15:07:40.692477 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.692461    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 15:07:40.694774 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.694758    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 15:07:40.742673 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.742656    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 15:07:40.744015 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.744000    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
May 28 15:07:40.744103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.744049    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
May 28 15:07:40.744103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.744061    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
May 28 15:07:40.744103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.744079    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-0.ec2.internal"
May 28 15:07:40.752298 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.752275    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-0.ec2.internal"
May 28 15:07:40.752298 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.752300    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-0.ec2.internal\": node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:40.763367 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.763349    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:40.793211 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.793187    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"]
May 28 15:07:40.793260 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.793246    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 15:07:40.794408 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.794395    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
May 28 15:07:40.794463 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.794426    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
May 28 15:07:40.794463 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.794436    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
May 28 15:07:40.795491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.795479    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 15:07:40.795632 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.795619    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.795710 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.795645    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 15:07:40.796222 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.796209    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
May 28 15:07:40.796303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.796234    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
May 28 15:07:40.796303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.796247    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
May 28 15:07:40.796303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.796263    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
May 28 15:07:40.796303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.796280    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
May 28 15:07:40.796303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.796292    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
May 28 15:07:40.797316 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.797301    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.797367 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.797335    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 15:07:40.797922 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.797907    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
May 28 15:07:40.797998 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.797932    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
May 28 15:07:40.797998 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.797942    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
May 28 15:07:40.820733 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.820712    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
May 28 15:07:40.825357 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.825342    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
May 28 15:07:40.863616 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.863598    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:40.884893 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.884851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/76097fc32951062d411719c8e34ca42c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"76097fc32951062d411719c8e34ca42c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.884893 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.884884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76097fc32951062d411719c8e34ca42c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"76097fc32951062d411719c8e34ca42c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.885039 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.884910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2670e491eb4e43f6abb8d7eca0e403fa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"2670e491eb4e43f6abb8d7eca0e403fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.963748 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:40.963725    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:40.986048 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.986032    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/76097fc32951062d411719c8e34ca42c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"76097fc32951062d411719c8e34ca42c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.986093 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.986058    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/76097fc32951062d411719c8e34ca42c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"76097fc32951062d411719c8e34ca42c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.986128 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.986096    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76097fc32951062d411719c8e34ca42c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"76097fc32951062d411719c8e34ca42c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.986128 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.986116    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2670e491eb4e43f6abb8d7eca0e403fa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"2670e491eb4e43f6abb8d7eca0e403fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.986187 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.986169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2670e491eb4e43f6abb8d7eca0e403fa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"2670e491eb4e43f6abb8d7eca0e403fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
May 28 15:07:40.986218 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:40.986181    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76097fc32951062d411719c8e34ca42c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"76097fc32951062d411719c8e34ca42c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:41.064344 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.064321    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:41.122705 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.122690    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:41.129258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.129245    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
May 28 15:07:41.164655 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.164616    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:41.265080 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.265060    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:41.365600 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.365580    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:41.466187 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.466139    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 15:07:41.466187 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.466142    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
May 28 15:07:41.466736 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.466253    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 15:07:41.466736 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.466262    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 15:07:41.544319 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.544300    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 15:07:41.553443 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.553427    2562 apiserver.go:52] "Watching apiserver"
May 28 15:07:41.565059 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.565033    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 15:07:41.565361 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.565341    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-r6vpj","openshift-dns/node-resolver-v79m4","openshift-image-registry/node-ca-df95z","openshift-multus/multus-mqp7m","openshift-multus/network-metrics-daemon-nvz75","openshift-network-diagnostics/network-check-target-dzrhm","openshift-ovn-kubernetes/ovnkube-node-rvd87","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6","openshift-cluster-node-tuning-operator/tuned-hbdj9","openshift-multus/multus-additional-cni-plugins-7lshn","openshift-network-operator/iptables-alerter-xwtdj"]
May 28 15:07:41.569991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.569973    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.572066 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572049    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.572478 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572195    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 15:02:40 +0000 UTC" deadline="2028-02-11 14:47:16.30832762 +0000 UTC"
May 28 15:07:41.572478 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572238    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.572478 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572244    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14975h39m34.73608794s"
May 28 15:07:41.572478 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572384    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8lv5g\""
May 28 15:07:41.572639 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572503    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 15:07:41.572639 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.572557    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 15:07:41.573892 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.573876    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.574872    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.575101    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.575411    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k29js\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.575422    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7mzdh\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.575590    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.575950    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.576036    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.576249    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.576393    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 15:07:41.576715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.576704    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jm57m\""
May 28 15:07:41.577228 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.576729    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 15:07:41.577228 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.576812    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 15:07:41.580188 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.580170    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:41.580263 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.580240    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:41.581954 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.581938    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:41.582055 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.581989    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:41.582117 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.582107    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.583204 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.583186    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 15:07:41.583204 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.583198    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
May 28 15:07:41.584061 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.584043    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.585611 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.585595    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 15:07:41.585952 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.585924    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 15:07:41.585952 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.585947    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 15:07:41.586053 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.585960    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 15:07:41.586053 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.585928    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 15:07:41.586053 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.585964    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hl9fb\""
May 28 15:07:41.586205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.586089    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 15:07:41.586268 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.586252    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.586760 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.586742    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 15:07:41.587137 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.587121    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kfvqx\""
May 28 15:07:41.587209 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.587164    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 15:07:41.587269 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.587164    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 15:07:41.588267 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588251    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jcqlp\""
May 28 15:07:41.588521 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588505    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.588651 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588634    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 15:07:41.588712 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588657    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 15:07:41.588712 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.588712 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-k8s-cni-cncf-io\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.588860 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-cni-bin\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.588860 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4648f74-0eab-4362-b95c-f41f3ac3253e-hosts-file\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.588860 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-cni-multus\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a47eaca-b1e4-4b34-8ba4-ea76cc479882-konnectivity-ca\") pod \"konnectivity-agent-r6vpj\" (UID: \"8a47eaca-b1e4-4b34-8ba4-ea76cc479882\") " pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.589001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7b4r\" (UniqueName: \"kubernetes.io/projected/523e2e5d-3908-45f1-bdad-676bee5d9082-kube-api-access-m7b4r\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:41.589001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-node-log\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-cni-netd\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovnkube-script-lib\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.588986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-systemd-units\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-run-netns\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovnkube-config\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-registration-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zhs\" (UniqueName: \"kubernetes.io/projected/72c24100-3b4f-4f47-b953-d4aa3692f247-kube-api-access-n7zhs\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-kubelet\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-hostroot\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6464f135-aaa3-4d79-b4ae-4e8d462333a3-host\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-ovn\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589214 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6f44\" (UniqueName: \"kubernetes.io/projected/47cd6e2c-0341-490e-b8cf-79420ab39cce-kube-api-access-r6f44\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-system-cni-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-cnibin\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-socket-dir-parent\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-conf-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhtt\" (UniqueName: \"kubernetes.io/projected/a4648f74-0eab-4362-b95c-f41f3ac3253e-kube-api-access-xlhtt\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-var-lib-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-log-socket\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-etc-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a47eaca-b1e4-4b34-8ba4-ea76cc479882-agent-certs\") pod \"konnectivity-agent-r6vpj\" (UID: \"8a47eaca-b1e4-4b34-8ba4-ea76cc479882\") " pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4648f74-0eab-4362-b95c-f41f3ac3253e-tmp-dir\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6464f135-aaa3-4d79-b4ae-4e8d462333a3-serviceca\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.589594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-socket-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjzn\" (UniqueName: \"kubernetes.io/projected/6464f135-aaa3-4d79-b4ae-4e8d462333a3-kube-api-access-txjzn\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-env-overrides\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-cni-binary-copy\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-slash\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-cni-bin\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-device-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-sys-fs\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-os-release\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99l2f\" (UniqueName: \"kubernetes.io/projected/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-kube-api-access-99l2f\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-kubelet\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-systemd\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-etc-kubernetes\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-cni-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-netns\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovn-node-metrics-cert\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.590191 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-daemon-config\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590780 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.589887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-multus-certs\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.590780 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.590662    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j5fnz\""
May 28 15:07:41.590780 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.590688    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 15:07:41.590921 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.590899    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 15:07:41.591048 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.590978    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.593167 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.593142    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kx5qm\""
May 28 15:07:41.593167 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.593158    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 15:07:41.593303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.593190    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 15:07:41.593303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.593195    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 15:07:41.594442 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.594426    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"]
May 28 15:07:41.595546 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.595531    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 15:07:41.595610 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.595593    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
May 28 15:07:41.599352 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.599336    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 15:07:41.603268 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.603243    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"]
May 28 15:07:41.603407 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.603394    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 15:07:41.620218 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.620197    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pm6r5"
May 28 15:07:41.625780 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.625764    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pm6r5"
May 28 15:07:41.663557 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.663524    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2670e491eb4e43f6abb8d7eca0e403fa.slice/crio-695fd4710a30a5bb215e7e3e0bf25369ad787dc6b72d6dead1c77d77850e5a5b WatchSource:0}: Error finding container 695fd4710a30a5bb215e7e3e0bf25369ad787dc6b72d6dead1c77d77850e5a5b: Status 404 returned error can't find the container with id 695fd4710a30a5bb215e7e3e0bf25369ad787dc6b72d6dead1c77d77850e5a5b
May 28 15:07:41.663748 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.663728    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76097fc32951062d411719c8e34ca42c.slice/crio-99fac781971dd67c885fa2058301ff8ed35327be5629a819a5bdab54b0e68dbe WatchSource:0}: Error finding container 99fac781971dd67c885fa2058301ff8ed35327be5629a819a5bdab54b0e68dbe: Status 404 returned error can't find the container with id 99fac781971dd67c885fa2058301ff8ed35327be5629a819a5bdab54b0e68dbe
May 28 15:07:41.668154 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.668140    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:07:41.683813 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.683794    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 15:07:41.690180 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690160    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovn-node-metrics-cert\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690232 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690196    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-daemon-config\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690232 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690224    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-multus-certs\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690311 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690254    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690311 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690283    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-k8s-cni-cncf-io\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690307    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-cni-bin\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690332    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4648f74-0eab-4362-b95c-f41f3ac3253e-hosts-file\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690359    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-cni-multus\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-k8s-cni-cncf-io\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690375    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-multus-certs\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690384    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a47eaca-b1e4-4b34-8ba4-ea76cc479882-konnectivity-ca\") pod \"konnectivity-agent-r6vpj\" (UID: \"8a47eaca-b1e4-4b34-8ba4-ea76cc479882\") " pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.690406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-cni-bin\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690423    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7b4r\" (UniqueName: \"kubernetes.io/projected/523e2e5d-3908-45f1-bdad-676bee5d9082-kube-api-access-m7b4r\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4648f74-0eab-4362-b95c-f41f3ac3253e-hosts-file\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-systemd\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690495    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-node-log\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-cni-multus\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690522    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-cni-netd\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690549    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-node-log\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690549    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovnkube-script-lib\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690558    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-tuned\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690621    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-systemd-units\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690644    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-run-netns\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovnkube-config\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cnibin\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.690722 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690717    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690743    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-registration-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690769    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zhs\" (UniqueName: \"kubernetes.io/projected/72c24100-3b4f-4f47-b953-d4aa3692f247-kube-api-access-n7zhs\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690797    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-kubelet\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690822    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-hostroot\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690847    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6464f135-aaa3-4d79-b4ae-4e8d462333a3-host\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690850    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-daemon-config\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690872    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-ovn\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690896    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6f44\" (UniqueName: \"kubernetes.io/projected/47cd6e2c-0341-490e-b8cf-79420ab39cce-kube-api-access-r6f44\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690921    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-system-cni-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-systemd-units\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a47eaca-b1e4-4b34-8ba4-ea76cc479882-konnectivity-ca\") pod \"konnectivity-agent-r6vpj\" (UID: \"8a47eaca-b1e4-4b34-8ba4-ea76cc479882\") " pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690952    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-cnibin\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-system-cni-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.690980    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-socket-dir-parent\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-hostroot\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-socket-dir-parent\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovnkube-script-lib\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.691491 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691079    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-registration-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691093    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-conf-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691100    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6464f135-aaa3-4d79-b4ae-4e8d462333a3-host\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691010    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-conf-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691136    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhtt\" (UniqueName: \"kubernetes.io/projected/a4648f74-0eab-4362-b95c-f41f3ac3253e-kube-api-access-xlhtt\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysconfig\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-cnibin\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691188    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-var-lib-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691208    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-ovn\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691211    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-kubernetes\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-cni-netd\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-sys\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d304d498-2f64-4e13-81d3-fed8f25fa271-tmp\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-system-cni-dir\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-iptables-alerter-script\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-host-slash\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.692346 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691436    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-log-socket\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-run-netns\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691453    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-var-lib-kubelet\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691494    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-log-socket\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysctl-d\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691495    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-var-lib-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691569    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-etc-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691602    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-etc-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691701    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691731    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a47eaca-b1e4-4b34-8ba4-ea76cc479882-agent-certs\") pod \"konnectivity-agent-r6vpj\" (UID: \"8a47eaca-b1e4-4b34-8ba4-ea76cc479882\") " pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691742    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovnkube-config\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691757    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4648f74-0eab-4362-b95c-f41f3ac3253e-tmp-dir\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.693258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691782    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6464f135-aaa3-4d79-b4ae-4e8d462333a3-serviceca\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691859    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691885    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-socket-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691913    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txjzn\" (UniqueName: \"kubernetes.io/projected/6464f135-aaa3-4d79-b4ae-4e8d462333a3-kube-api-access-txjzn\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysctl-conf\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntg48\" (UniqueName: \"kubernetes.io/projected/d304d498-2f64-4e13-81d3-fed8f25fa271-kube-api-access-ntg48\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.691992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-os-release\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692077    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-env-overrides\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692102    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-cni-binary-copy\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-host\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692158    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-slash\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692165    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-openvswitch\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692182    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-cni-bin\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692207    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6464f135-aaa3-4d79-b4ae-4e8d462333a3-serviceca\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692211    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-device-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.693868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692238    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-sys-fs\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-socket-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692101    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4648f74-0eab-4362-b95c-f41f3ac3253e-tmp-dir\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-slash\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692530    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-cni-bin\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-sys-fs\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692617    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47cd6e2c-0341-490e-b8cf-79420ab39cce-env-overrides\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692666    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72c24100-3b4f-4f47-b953-d4aa3692f247-device-dir\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692683    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-os-release\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-cni-binary-copy\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692721    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99l2f\" (UniqueName: \"kubernetes.io/projected/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-kube-api-access-99l2f\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692749    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-os-release\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-modprobe-d\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692783    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-kubelet\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692799    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-systemd\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692814    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-etc-kubernetes\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692828    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-run\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.694484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-var-lib-kubelet\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-run-systemd\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9qt\" (UniqueName: \"kubernetes.io/projected/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-kube-api-access-2p9qt\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692917    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-cni-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692920    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47cd6e2c-0341-490e-b8cf-79420ab39cce-host-kubelet\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-etc-kubernetes\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.692967    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-netns\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.693002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-multus-cni-dir\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.693001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.693048    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.693068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-lib-modules\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.693073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-host-run-netns\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.693095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffzw6\" (UniqueName: \"kubernetes.io/projected/db277cdc-530e-4b95-9e35-9ea0f4e609ce-kube-api-access-ffzw6\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.693103    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:42.193088496 +0000 UTC m=+2.126761367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.693485    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47cd6e2c-0341-490e-b8cf-79420ab39cce-ovn-node-metrics-cert\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.694345    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a47eaca-b1e4-4b34-8ba4-ea76cc479882-agent-certs\") pod \"konnectivity-agent-r6vpj\" (UID: \"8a47eaca-b1e4-4b34-8ba4-ea76cc479882\") " pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.695096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.694810    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"76097fc32951062d411719c8e34ca42c","Type":"ContainerStarted","Data":"99fac781971dd67c885fa2058301ff8ed35327be5629a819a5bdab54b0e68dbe"}
May 28 15:07:41.695809 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.695792    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" event={"ID":"2670e491eb4e43f6abb8d7eca0e403fa","Type":"ContainerStarted","Data":"695fd4710a30a5bb215e7e3e0bf25369ad787dc6b72d6dead1c77d77850e5a5b"}
May 28 15:07:41.699583 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.699524    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:07:41.699583 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.699551    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:07:41.699583 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.699565    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:41.699583 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:41.699626    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:42.199608298 +0000 UTC m=+2.133281186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:41.700484 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.700459    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7b4r\" (UniqueName: \"kubernetes.io/projected/523e2e5d-3908-45f1-bdad-676bee5d9082-kube-api-access-m7b4r\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:41.701442 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.701414    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6f44\" (UniqueName: \"kubernetes.io/projected/47cd6e2c-0341-490e-b8cf-79420ab39cce-kube-api-access-r6f44\") pod \"ovnkube-node-rvd87\" (UID: \"47cd6e2c-0341-490e-b8cf-79420ab39cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.701606 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.701587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99l2f\" (UniqueName: \"kubernetes.io/projected/7ddad515-f9c0-4f4e-999c-576cd0e7ec23-kube-api-access-99l2f\") pod \"multus-mqp7m\" (UID: \"7ddad515-f9c0-4f4e-999c-576cd0e7ec23\") " pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.701735 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.701715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhtt\" (UniqueName: \"kubernetes.io/projected/a4648f74-0eab-4362-b95c-f41f3ac3253e-kube-api-access-xlhtt\") pod \"node-resolver-v79m4\" (UID: \"a4648f74-0eab-4362-b95c-f41f3ac3253e\") " pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.701793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.701766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zhs\" (UniqueName: \"kubernetes.io/projected/72c24100-3b4f-4f47-b953-d4aa3692f247-kube-api-access-n7zhs\") pod \"aws-ebs-csi-driver-node-9z4b6\" (UID: \"72c24100-3b4f-4f47-b953-d4aa3692f247\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.701997 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.701980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjzn\" (UniqueName: \"kubernetes.io/projected/6464f135-aaa3-4d79-b4ae-4e8d462333a3-kube-api-access-txjzn\") pod \"node-ca-df95z\" (UID: \"6464f135-aaa3-4d79-b4ae-4e8d462333a3\") " pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.793464 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793402    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cnibin\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.793464 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793445    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysconfig\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793464 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793461    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-kubernetes\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793475    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-sys\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793488    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d304d498-2f64-4e13-81d3-fed8f25fa271-tmp\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cnibin\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793544    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysconfig\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-kubernetes\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-sys\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793584    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-system-cni-dir\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793616    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-iptables-alerter-script\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793642    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-host-slash\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-system-cni-dir\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.793669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysctl-d\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-host-slash\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793690    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793720    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793746    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysctl-conf\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793761    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysctl-d\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793771    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntg48\" (UniqueName: \"kubernetes.io/projected/d304d498-2f64-4e13-81d3-fed8f25fa271-kube-api-access-ntg48\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793795    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-os-release\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793822    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793850    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-host\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793879    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-modprobe-d\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793884    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-os-release\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793930    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-run\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793954    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-var-lib-kubelet\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793976    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9qt\" (UniqueName: \"kubernetes.io/projected/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-kube-api-access-2p9qt\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-modprobe-d\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794001    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794050    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-lib-modules\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794079    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffzw6\" (UniqueName: \"kubernetes.io/projected/db277cdc-530e-4b95-9e35-9ea0f4e609ce-kube-api-access-ffzw6\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794119    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-systemd\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-run\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794145    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-tuned\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-var-lib-kubelet\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794051    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-host\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.793851    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-sysctl-conf\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-iptables-alerter-script\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-systemd\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d304d498-2f64-4e13-81d3-fed8f25fa271-lib-modules\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794442    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db277cdc-530e-4b95-9e35-9ea0f4e609ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.794799 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.794697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db277cdc-530e-4b95-9e35-9ea0f4e609ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.795374 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.795358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d304d498-2f64-4e13-81d3-fed8f25fa271-tmp\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.796203 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.796185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d304d498-2f64-4e13-81d3-fed8f25fa271-etc-tuned\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.801849 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.801828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntg48\" (UniqueName: \"kubernetes.io/projected/d304d498-2f64-4e13-81d3-fed8f25fa271-kube-api-access-ntg48\") pod \"tuned-hbdj9\" (UID: \"d304d498-2f64-4e13-81d3-fed8f25fa271\") " pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.802187 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.802168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9qt\" (UniqueName: \"kubernetes.io/projected/cda3e706-3514-47fd-b1f4-a8c4abbcf9cf-kube-api-access-2p9qt\") pod \"iptables-alerter-xwtdj\" (UID: \"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf\") " pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.802264 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.802234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffzw6\" (UniqueName: \"kubernetes.io/projected/db277cdc-530e-4b95-9e35-9ea0f4e609ce-kube-api-access-ffzw6\") pod \"multus-additional-cni-plugins-7lshn\" (UID: \"db277cdc-530e-4b95-9e35-9ea0f4e609ce\") " pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.895052 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.895014    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:07:41.901830 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.901810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a47eaca_b1e4_4b34_8ba4_ea76cc479882.slice/crio-c5231bd64f62dca6275a870d0ab4c68bb97ccf4211abc775295cf03c7ed8e84a WatchSource:0}: Error finding container c5231bd64f62dca6275a870d0ab4c68bb97ccf4211abc775295cf03c7ed8e84a: Status 404 returned error can't find the container with id c5231bd64f62dca6275a870d0ab4c68bb97ccf4211abc775295cf03c7ed8e84a
May 28 15:07:41.909234 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.909205    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v79m4"
May 28 15:07:41.914566 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.914546    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4648f74_0eab_4362_b95c_f41f3ac3253e.slice/crio-314226680d3078c97c8b0be69e3aa6bfaf52c2e5e4f936cc5c54829e0ade51ae WatchSource:0}: Error finding container 314226680d3078c97c8b0be69e3aa6bfaf52c2e5e4f936cc5c54829e0ade51ae: Status 404 returned error can't find the container with id 314226680d3078c97c8b0be69e3aa6bfaf52c2e5e4f936cc5c54829e0ade51ae
May 28 15:07:41.927695 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.927682    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-df95z"
May 28 15:07:41.932650 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.932629    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6464f135_aaa3_4d79_b4ae_4e8d462333a3.slice/crio-92470e80254a8fe59f9ab657b17411b7fff9b0951f4dea60a069e8ef5df79426 WatchSource:0}: Error finding container 92470e80254a8fe59f9ab657b17411b7fff9b0951f4dea60a069e8ef5df79426: Status 404 returned error can't find the container with id 92470e80254a8fe59f9ab657b17411b7fff9b0951f4dea60a069e8ef5df79426
May 28 15:07:41.943373 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.943357    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mqp7m"
May 28 15:07:41.948290 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.948272    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddad515_f9c0_4f4e_999c_576cd0e7ec23.slice/crio-cc0c8a24c808ac867418336c4cce1359c0ae291cda819b7c32b635a1a5852904 WatchSource:0}: Error finding container cc0c8a24c808ac867418336c4cce1359c0ae291cda819b7c32b635a1a5852904: Status 404 returned error can't find the container with id cc0c8a24c808ac867418336c4cce1359c0ae291cda819b7c32b635a1a5852904
May 28 15:07:41.970216 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.970199    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:07:41.975477 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.975460    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6"
May 28 15:07:41.976557 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.976537    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cd6e2c_0341_490e_b8cf_79420ab39cce.slice/crio-aa91af15f6e0336f426a3c2143ed0bfb0def7c169ae8f4151273187d50352dfa WatchSource:0}: Error finding container aa91af15f6e0336f426a3c2143ed0bfb0def7c169ae8f4151273187d50352dfa: Status 404 returned error can't find the container with id aa91af15f6e0336f426a3c2143ed0bfb0def7c169ae8f4151273187d50352dfa
May 28 15:07:41.980837 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.980817    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c24100_3b4f_4f47_b953_d4aa3692f247.slice/crio-0b033ae55574939b35c49fdad5ae5803a2e2b6c53475c0d7fce267aed85e3489 WatchSource:0}: Error finding container 0b033ae55574939b35c49fdad5ae5803a2e2b6c53475c0d7fce267aed85e3489: Status 404 returned error can't find the container with id 0b033ae55574939b35c49fdad5ae5803a2e2b6c53475c0d7fce267aed85e3489
May 28 15:07:41.981794 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.981780    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hbdj9"
May 28 15:07:41.986904 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.986882    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd304d498_2f64_4e13_81d3_fed8f25fa271.slice/crio-87c938e84bb64052e6f8499ab5f15422f347c4e01e31a1c4c161b863dd5519dc WatchSource:0}: Error finding container 87c938e84bb64052e6f8499ab5f15422f347c4e01e31a1c4c161b863dd5519dc: Status 404 returned error can't find the container with id 87c938e84bb64052e6f8499ab5f15422f347c4e01e31a1c4c161b863dd5519dc
May 28 15:07:41.987641 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.987627    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7lshn"
May 28 15:07:41.993884 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:41.993863    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwtdj"
May 28 15:07:41.994185 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.994162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb277cdc_530e_4b95_9e35_9ea0f4e609ce.slice/crio-cdd52aef37190ad8960d96344e83dd6864badd7ad81c24ac2ef1e86755a0d871 WatchSource:0}: Error finding container cdd52aef37190ad8960d96344e83dd6864badd7ad81c24ac2ef1e86755a0d871: Status 404 returned error can't find the container with id cdd52aef37190ad8960d96344e83dd6864badd7ad81c24ac2ef1e86755a0d871
May 28 15:07:41.999678 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:07:41.999658    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda3e706_3514_47fd_b1f4_a8c4abbcf9cf.slice/crio-afd4b4f734ea77e1cb995b357424ac6325db518972dc79b0d5c522a8c643608f WatchSource:0}: Error finding container afd4b4f734ea77e1cb995b357424ac6325db518972dc79b0d5c522a8c643608f: Status 404 returned error can't find the container with id afd4b4f734ea77e1cb995b357424ac6325db518972dc79b0d5c522a8c643608f
May 28 15:07:42.163658 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.163592    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 15:07:42.197403 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.197379    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:42.197541 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:42.197522    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:42.197643 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:42.197582    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:43.197566499 +0000 UTC m=+3.131239388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:42.298269 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.298232    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:42.298401 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:42.298382    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:07:42.298475 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:42.298405    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:07:42.298475 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:42.298419    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:42.298475 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:42.298474    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:43.298456582 +0000 UTC m=+3.232129459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:42.627493 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.627149    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:02:41 +0000 UTC" deadline="2027-10-31 02:05:17.726721425 +0000 UTC"
May 28 15:07:42.627493 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.627395    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12490h57m35.099332272s"
May 28 15:07:42.639742 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.639539    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 15:07:42.716882 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.716845    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerStarted","Data":"cdd52aef37190ad8960d96344e83dd6864badd7ad81c24ac2ef1e86755a0d871"}
May 28 15:07:42.734000 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.733931    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6" event={"ID":"72c24100-3b4f-4f47-b953-d4aa3692f247","Type":"ContainerStarted","Data":"0b033ae55574939b35c49fdad5ae5803a2e2b6c53475c0d7fce267aed85e3489"}
May 28 15:07:42.755205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.755167    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6vpj" event={"ID":"8a47eaca-b1e4-4b34-8ba4-ea76cc479882","Type":"ContainerStarted","Data":"c5231bd64f62dca6275a870d0ab4c68bb97ccf4211abc775295cf03c7ed8e84a"}
May 28 15:07:42.765909 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.765880    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwtdj" event={"ID":"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf","Type":"ContainerStarted","Data":"afd4b4f734ea77e1cb995b357424ac6325db518972dc79b0d5c522a8c643608f"}
May 28 15:07:42.776367 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.776343    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hbdj9" event={"ID":"d304d498-2f64-4e13-81d3-fed8f25fa271","Type":"ContainerStarted","Data":"87c938e84bb64052e6f8499ab5f15422f347c4e01e31a1c4c161b863dd5519dc"}
May 28 15:07:42.785377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.785349    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"aa91af15f6e0336f426a3c2143ed0bfb0def7c169ae8f4151273187d50352dfa"}
May 28 15:07:42.803727 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.803687    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mqp7m" event={"ID":"7ddad515-f9c0-4f4e-999c-576cd0e7ec23","Type":"ContainerStarted","Data":"cc0c8a24c808ac867418336c4cce1359c0ae291cda819b7c32b635a1a5852904"}
May 28 15:07:42.809634 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.809607    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-df95z" event={"ID":"6464f135-aaa3-4d79-b4ae-4e8d462333a3","Type":"ContainerStarted","Data":"92470e80254a8fe59f9ab657b17411b7fff9b0951f4dea60a069e8ef5df79426"}
May 28 15:07:42.824703 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.824638    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v79m4" event={"ID":"a4648f74-0eab-4362-b95c-f41f3ac3253e","Type":"ContainerStarted","Data":"314226680d3078c97c8b0be69e3aa6bfaf52c2e5e4f936cc5c54829e0ade51ae"}
May 28 15:07:42.933237 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:42.932899    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 15:07:43.203612 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.203528    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:43.203804 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.203695    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:43.203804 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.203754    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:45.203735368 +0000 UTC m=+5.137408242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:43.305107 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.304471    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:43.305107 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.304672    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:07:43.305107 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.304692    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:07:43.305107 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.304704    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:43.305107 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.304758    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:45.30474062 +0000 UTC m=+5.238413504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:43.628438 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.628352    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:02:41 +0000 UTC" deadline="2027-11-29 08:55:03.899114297 +0000 UTC"
May 28 15:07:43.628438 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.628390    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13193h47m20.27072852s"
May 28 15:07:43.694419 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.693598    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:43.694419 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.693757    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:43.694419 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.694209    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:43.694419 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.694302    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:43.987660 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.986241    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6bshc"]
May 28 15:07:43.992405 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:43.992222    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:43.992405 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:43.992303    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:44.009957 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.009810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e9968b0-d208-489b-8213-a723d613a84a-kubelet-config\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.009957 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.009859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e9968b0-d208-489b-8213-a723d613a84a-dbus\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.009957 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.009910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.110791 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.110732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e9968b0-d208-489b-8213-a723d613a84a-dbus\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.110951 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.110832    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.110951 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.110889    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e9968b0-d208-489b-8213-a723d613a84a-kubelet-config\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.111090 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.110980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e9968b0-d208-489b-8213-a723d613a84a-kubelet-config\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.111137 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.111122    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e9968b0-d208-489b-8213-a723d613a84a-dbus\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.111230 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:44.111215    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 15:07:44.111413 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:44.111398    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret podName:0e9968b0-d208-489b-8213-a723d613a84a nodeName:}" failed. No retries permitted until 2026-05-28 15:07:44.611344145 +0000 UTC m=+4.545017022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret") pod "global-pull-secret-syncer-6bshc" (UID: "0e9968b0-d208-489b-8213-a723d613a84a") : object "kube-system"/"original-pull-secret" not registered
May 28 15:07:44.615304 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:44.615271    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:44.615465 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:44.615450    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 15:07:44.615518 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:44.615505    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret podName:0e9968b0-d208-489b-8213-a723d613a84a nodeName:}" failed. No retries permitted until 2026-05-28 15:07:45.615488163 +0000 UTC m=+5.549161047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret") pod "global-pull-secret-syncer-6bshc" (UID: "0e9968b0-d208-489b-8213-a723d613a84a") : object "kube-system"/"original-pull-secret" not registered
May 28 15:07:45.221923 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:45.221342    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:45.221923 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.221493    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:45.221923 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.221562    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:49.221543342 +0000 UTC m=+9.155216229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:45.322641 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:45.322600    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:45.322792 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.322779    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:07:45.322850 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.322800    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:07:45.322850 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.322813    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:45.322960 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.322879    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:49.322852506 +0000 UTC m=+9.256525394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:45.625088 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:45.624992    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:45.625239 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.625154    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 15:07:45.625239 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.625219    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret podName:0e9968b0-d208-489b-8213-a723d613a84a nodeName:}" failed. No retries permitted until 2026-05-28 15:07:47.625200007 +0000 UTC m=+7.558872895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret") pod "global-pull-secret-syncer-6bshc" (UID: "0e9968b0-d208-489b-8213-a723d613a84a") : object "kube-system"/"original-pull-secret" not registered
May 28 15:07:45.692788 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:45.692759    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:45.692965 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.692854    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:45.693265 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:45.693241    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:45.693394 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.693371    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:45.693604 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:45.693467    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:45.693604 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:45.693558    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:47.641839 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:47.641806    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:47.642268 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:47.641968    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 15:07:47.642268 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:47.642046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret podName:0e9968b0-d208-489b-8213-a723d613a84a nodeName:}" failed. No retries permitted until 2026-05-28 15:07:51.642009663 +0000 UTC m=+11.575682548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret") pod "global-pull-secret-syncer-6bshc" (UID: "0e9968b0-d208-489b-8213-a723d613a84a") : object "kube-system"/"original-pull-secret" not registered
May 28 15:07:47.692829 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:47.692797    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:47.692994 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:47.692923    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:47.693335 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:47.693301    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:47.693462 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:47.693394    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:47.693531 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:47.693461    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:47.693580 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:47.693542    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:49.254125 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:49.254090    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:49.254560 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.254263    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:49.254560 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.254323    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:57.254305628 +0000 UTC m=+17.187978504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:49.354680 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:49.354641    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:49.354855 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.354819    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:07:49.354855 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.354844    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:07:49.354855 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.354857    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:49.355014 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.354917    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:07:57.354898855 +0000 UTC m=+17.288571742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:49.693591 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:49.693511    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:49.693738 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.693637    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:49.693738 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:49.693717    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:49.693849 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.693803    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:49.694250 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:49.694088    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:49.694250 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:49.694157    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:51.673258 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:51.673220    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:51.673822 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:51.673427    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 15:07:51.673822 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:51.673480    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret podName:0e9968b0-d208-489b-8213-a723d613a84a nodeName:}" failed. No retries permitted until 2026-05-28 15:07:59.673466458 +0000 UTC m=+19.607139329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret") pod "global-pull-secret-syncer-6bshc" (UID: "0e9968b0-d208-489b-8213-a723d613a84a") : object "kube-system"/"original-pull-secret" not registered
May 28 15:07:51.693182 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:51.693153    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:51.693295 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:51.693265    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:51.693605 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:51.693584    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:51.693699 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:51.693673    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:51.693777 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:51.693739    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:51.693840 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:51.693819    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:53.693176 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:53.693146    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:53.693637 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:53.693147    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:53.693637 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:53.693255    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:53.693637 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:53.693148    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:53.693637 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:53.693333    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:53.693637 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:53.693447    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:55.692995 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:55.692965    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:55.693439 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:55.693078    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:55.693439 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:55.692964    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:55.693439 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:55.692964    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:55.693439 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:55.693152    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:55.693439 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:55.693209    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:57.313273 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:57.313234    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:57.313713 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.313385    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:57.313713 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.313449    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:08:13.313432087 +0000 UTC m=+33.247104962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:07:57.413862 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:57.413830    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:57.414040 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.414004    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:07:57.414100 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.414048    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:07:57.414100 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.414059    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:57.414177 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.414106    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:08:13.41409274 +0000 UTC m=+33.347765615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:07:57.693579 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:57.693547    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:57.693579 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:57.693581    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:57.693800 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:57.693607    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:57.693800 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.693687    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:57.693800 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.693771    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:57.693932 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:57.693858    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:59.693153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:59.693121    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:07:59.693578 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:59.693170    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:07:59.693578 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:59.693118    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:59.693578 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:59.693243    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:07:59.693578 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:59.693341    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:07:59.693578 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:59.693399    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:07:59.729773 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:07:59.729745    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:07:59.729924 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:59.729856    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 15:07:59.729924 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:07:59.729909    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret podName:0e9968b0-d208-489b-8213-a723d613a84a nodeName:}" failed. No retries permitted until 2026-05-28 15:08:15.729890079 +0000 UTC m=+35.663562954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret") pod "global-pull-secret-syncer-6bshc" (UID: "0e9968b0-d208-489b-8213-a723d613a84a") : object "kube-system"/"original-pull-secret" not registered
May 28 15:08:01.693420 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.693280    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:01.693689 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.693311    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:01.693689 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:01.693490    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:01.693689 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.693343    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:01.693689 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:01.693565    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:01.693689 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:01.693663    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:01.863910 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.863885    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hbdj9" event={"ID":"d304d498-2f64-4e13-81d3-fed8f25fa271","Type":"ContainerStarted","Data":"ffc720e11d79c5e7ec88896fdde0be9641c445a2f2897fa1500732a06fccd3d5"}
May 28 15:08:01.866278 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.866201    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:08:01.866859 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.866831    2562 generic.go:358] "Generic (PLEG): container finished" podID="47cd6e2c-0341-490e-b8cf-79420ab39cce" containerID="93f6c4f5c400418f31c373c88b177100021a1ab3c020574f54fe26b1bb66325d" exitCode=1
May 28 15:08:01.866963 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.866908    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"9a3d83b14f3326633b3ade07f80997ec8d879e0292daff92c8a43e41484ad57e"}
May 28 15:08:01.866963 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.866927    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"eca53f4cee2d4253e46846f93acbbaab125fe8d6ded792f3b2a07565dadddc81"}
May 28 15:08:01.866963 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.866939    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerDied","Data":"93f6c4f5c400418f31c373c88b177100021a1ab3c020574f54fe26b1bb66325d"}
May 28 15:08:01.866963 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.866948    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"a57e0ba883eac9c2c267485146b9dfcd2c373d68148a8d41613802bc5fdd3095"}
May 28 15:08:01.871443 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.871414    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mqp7m" event={"ID":"7ddad515-f9c0-4f4e-999c-576cd0e7ec23","Type":"ContainerStarted","Data":"397ca33ce5c27fd7363a73559d948e635d86fa01fc4346272d237b06dae98eb4"}
May 28 15:08:01.876637 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.876595    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" event={"ID":"2670e491eb4e43f6abb8d7eca0e403fa","Type":"ContainerStarted","Data":"429d10f7d523016ec8a8feb38916f54be93b8e7b7ab4a6f2e21b8d8471c7c921"}
May 28 15:08:01.880445 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.880398    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hbdj9" podStartSLOduration=2.7880140239999998 podStartE2EDuration="21.880382682s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.988237831 +0000 UTC m=+1.921910702" lastFinishedPulling="2026-05-28 15:08:01.080606489 +0000 UTC m=+21.014279360" observedRunningTime="2026-05-28 15:08:01.879865518 +0000 UTC m=+21.813538411" watchObservedRunningTime="2026-05-28 15:08:01.880382682 +0000 UTC m=+21.814055578"
May 28 15:08:01.892473 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.892432    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" podStartSLOduration=20.892417537 podStartE2EDuration="20.892417537s" podCreationTimestamp="2026-05-28 15:07:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:08:01.89177754 +0000 UTC m=+21.825450433" watchObservedRunningTime="2026-05-28 15:08:01.892417537 +0000 UTC m=+21.826090429"
May 28 15:08:01.909423 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:01.909372    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mqp7m" podStartSLOduration=2.741095994 podStartE2EDuration="21.909358228s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.950088601 +0000 UTC m=+1.883761476" lastFinishedPulling="2026-05-28 15:08:01.118350828 +0000 UTC m=+21.052023710" observedRunningTime="2026-05-28 15:08:01.908443004 +0000 UTC m=+21.842115897" watchObservedRunningTime="2026-05-28 15:08:01.909358228 +0000 UTC m=+21.843031123"
May 28 15:08:02.879732 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.879665    2562 generic.go:358] "Generic (PLEG): container finished" podID="db277cdc-530e-4b95-9e35-9ea0f4e609ce" containerID="55084bf03aebd779e2b881aa119714a1ec707a57ab492d4af17c6370bc29b67f" exitCode=0
May 28 15:08:02.880452 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.879735    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerDied","Data":"55084bf03aebd779e2b881aa119714a1ec707a57ab492d4af17c6370bc29b67f"}
May 28 15:08:02.881097 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.880966    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6" event={"ID":"72c24100-3b4f-4f47-b953-d4aa3692f247","Type":"ContainerStarted","Data":"c261d3f42a6669e71b34b2d7bbd386ba131fdaed440e233cb113644617192a3f"}
May 28 15:08:02.882362 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.882233    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6vpj" event={"ID":"8a47eaca-b1e4-4b34-8ba4-ea76cc479882","Type":"ContainerStarted","Data":"56bd4fb3bd55e4ae7c066c3ece5817ff2bb0dc8d5403694c4b156d0f0d7c578c"}
May 28 15:08:02.883604 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.883579    2562 generic.go:358] "Generic (PLEG): container finished" podID="76097fc32951062d411719c8e34ca42c" containerID="583f81036df678159b9f6e0c7dac102b9d1505120c14bbc9a45f03b3f882521c" exitCode=0
May 28 15:08:02.883683 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.883657    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"76097fc32951062d411719c8e34ca42c","Type":"ContainerDied","Data":"583f81036df678159b9f6e0c7dac102b9d1505120c14bbc9a45f03b3f882521c"}
May 28 15:08:02.884967 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.884935    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwtdj" event={"ID":"cda3e706-3514-47fd-b1f4-a8c4abbcf9cf","Type":"ContainerStarted","Data":"e477ae14f91dbe693b32324b2e53c978a1619dae323b06334e1c38b4847f198b"}
May 28 15:08:02.887189 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.887173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:08:02.887500 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.887483    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"63f6041fc16bc1e0a570f9e19af728084dac776a11c06135aba5e473197ef905"}
May 28 15:08:02.887562 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.887505    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"25e07a14a5b584cffd4cdecf0058c666e66ef70eb7117411a8c05cf084b80399"}
May 28 15:08:02.888579 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.888564    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-df95z" event={"ID":"6464f135-aaa3-4d79-b4ae-4e8d462333a3","Type":"ContainerStarted","Data":"910ea07dc821268e4db69446955709b9865cae89d73cd7e6de66b136a7acfbc0"}
May 28 15:08:02.889677 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.889655    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v79m4" event={"ID":"a4648f74-0eab-4362-b95c-f41f3ac3253e","Type":"ContainerStarted","Data":"06a6f063de9305df220ba0d1a1753cab906c02bd46e9a13a1655106a4de4481b"}
May 28 15:08:02.926343 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.926298    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r6vpj" podStartSLOduration=4.015788309 podStartE2EDuration="22.926275829s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.903212085 +0000 UTC m=+1.836884959" lastFinishedPulling="2026-05-28 15:08:00.813699594 +0000 UTC m=+20.747372479" observedRunningTime="2026-05-28 15:08:02.925667636 +0000 UTC m=+22.859340529" watchObservedRunningTime="2026-05-28 15:08:02.926275829 +0000 UTC m=+22.859948723"
May 28 15:08:02.951568 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.951522    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-v79m4" podStartSLOduration=3.786644166 podStartE2EDuration="22.951509249s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.916520919 +0000 UTC m=+1.850193792" lastFinishedPulling="2026-05-28 15:08:01.081385993 +0000 UTC m=+21.015058875" observedRunningTime="2026-05-28 15:08:02.95141121 +0000 UTC m=+22.885084104" watchObservedRunningTime="2026-05-28 15:08:02.951509249 +0000 UTC m=+22.885182143"
May 28 15:08:02.951689 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.951614    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-df95z" podStartSLOduration=4.019129036 podStartE2EDuration="22.951608753s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.934013577 +0000 UTC m=+1.867686453" lastFinishedPulling="2026-05-28 15:08:00.866493293 +0000 UTC m=+20.800166170" observedRunningTime="2026-05-28 15:08:02.938318943 +0000 UTC m=+22.871991863" watchObservedRunningTime="2026-05-28 15:08:02.951608753 +0000 UTC m=+22.885281646"
May 28 15:08:02.964333 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:02.964301    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xwtdj" podStartSLOduration=4.098931635 podStartE2EDuration="22.964292586s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:42.001162524 +0000 UTC m=+1.934835398" lastFinishedPulling="2026-05-28 15:08:00.866523462 +0000 UTC m=+20.800196349" observedRunningTime="2026-05-28 15:08:02.964109787 +0000 UTC m=+22.897782676" watchObservedRunningTime="2026-05-28 15:08:02.964292586 +0000 UTC m=+22.897965479"
May 28 15:08:03.693418 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:03.693393    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:03.693599 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:03.693393    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:03.693599 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:03.693498    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:03.693703 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:03.693619    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:03.693703 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:03.693393    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:03.693791 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:03.693739    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:03.893891 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:03.893851    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"76097fc32951062d411719c8e34ca42c","Type":"ContainerStarted","Data":"38a01bc19e4685bd8064592d427ab398198bcf7bce1c7199696bc11c754fe087"}
May 28 15:08:03.908421 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:03.908377    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" podStartSLOduration=22.90835993 podStartE2EDuration="22.90835993s" podCreationTimestamp="2026-05-28 15:07:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:08:03.908001054 +0000 UTC m=+23.841673948" watchObservedRunningTime="2026-05-28 15:08:03.90835993 +0000 UTC m=+23.842032824"
May 28 15:08:04.145084 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.144907    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 15:08:04.656211 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.656089    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T15:08:04.145079649Z","UUID":"0ef4e6a1-68d4-443c-9e33-cfb57009ec03","Handler":null,"Name":"","Endpoint":""}
May 28 15:08:04.658006 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.657978    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 15:08:04.658006 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.658008    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 15:08:04.899056 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.899014    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:08:04.899569 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.899394    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"e4cb1a9def0862c2d8f5679784d9b00136e3afa51a824ab2b77dff98eb8b8999"}
May 28 15:08:04.901206 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:04.901179    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6" event={"ID":"72c24100-3b4f-4f47-b953-d4aa3692f247","Type":"ContainerStarted","Data":"e0eabb176f919386dd1b8fe08fe1d6717fca7b7159e3432a24c2fd2675462259"}
May 28 15:08:05.693178 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:05.693105    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:05.693326 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:05.693116    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:05.693326 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:05.693208    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:05.693326 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:05.693310    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:05.693480 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:05.693116    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:05.693480 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:05.693403    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:05.904522 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:05.904489    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6" event={"ID":"72c24100-3b4f-4f47-b953-d4aa3692f247","Type":"ContainerStarted","Data":"75f4cfe392acd33b83fc0eea0f2c9773fb444344590f7e93dbeaf6cdde2f5d48"}
May 28 15:08:06.909345 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:06.909193    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:08:06.909881 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:06.909730    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"1d10e8d39ebbee6ecbb839b4fa1cce6e3053778ffe7ed2cb07ffbdf971cb076d"}
May 28 15:08:06.910430 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:06.910410    2562 scope.go:117] "RemoveContainer" containerID="93f6c4f5c400418f31c373c88b177100021a1ab3c020574f54fe26b1bb66325d"
May 28 15:08:06.938821 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:06.938778    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z4b6" podStartSLOduration=3.525576302 podStartE2EDuration="26.938766761s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.982216449 +0000 UTC m=+1.915889324" lastFinishedPulling="2026-05-28 15:08:05.395406912 +0000 UTC m=+25.329079783" observedRunningTime="2026-05-28 15:08:05.923140292 +0000 UTC m=+25.856813184" watchObservedRunningTime="2026-05-28 15:08:06.938766761 +0000 UTC m=+26.872439661"
May 28 15:08:07.692776 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.692745    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:07.692922 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.692745    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:07.692922 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:07.692890    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:07.693084 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.692745    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:07.693084 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:07.692941    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:07.693084 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:07.693066    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:07.793693 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.793660    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:08:07.794367 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.794348    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:08:07.911324 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.911295    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:08:07.911905 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:07.911884    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r6vpj"
May 28 15:08:08.238611 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.238404    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6bshc"]
May 28 15:08:08.238611 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.238532    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:08.238842 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:08.238639    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:08.241259 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.241222    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvz75"]
May 28 15:08:08.241361 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.241316    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:08.241419 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:08.241401    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:08.254930 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.254903    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dzrhm"]
May 28 15:08:08.255002 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.254965    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:08.255063 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:08.255037    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:08.913986 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.913811    2562 generic.go:358] "Generic (PLEG): container finished" podID="db277cdc-530e-4b95-9e35-9ea0f4e609ce" containerID="e355ccf9e5f6b86f42e75af3195902fb8be4bb4b1d3875e853a29db1e68d2c71" exitCode=0
May 28 15:08:08.914329 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.913887    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerDied","Data":"e355ccf9e5f6b86f42e75af3195902fb8be4bb4b1d3875e853a29db1e68d2c71"}
May 28 15:08:08.920670 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.920648    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:08:08.921112 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.921083    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" event={"ID":"47cd6e2c-0341-490e-b8cf-79420ab39cce","Type":"ContainerStarted","Data":"7ca00a3b054970ea479e23e0371e4a56de066488c57e5cbe6d673420da4de5e8"}
May 28 15:08:08.921375 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.921355    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:08:08.921460 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.921383    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:08:08.921460 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.921395    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:08:08.936510 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.936479    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:08:08.936633 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.936615    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:08:08.965812 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:08.965776    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87" podStartSLOduration=9.863258736 podStartE2EDuration="28.965764714s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.978096414 +0000 UTC m=+1.911769285" lastFinishedPulling="2026-05-28 15:08:01.080602378 +0000 UTC m=+21.014275263" observedRunningTime="2026-05-28 15:08:08.965585009 +0000 UTC m=+28.899257902" watchObservedRunningTime="2026-05-28 15:08:08.965764714 +0000 UTC m=+28.899437604"
May 28 15:08:09.693286 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:09.693264    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:09.693371 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:09.693271    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:09.693432 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:09.693373    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:09.693432 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:09.693394    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:09.693543 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:09.693519    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:09.693638 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:09.693619    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:09.924188 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:09.924098    2562 generic.go:358] "Generic (PLEG): container finished" podID="db277cdc-530e-4b95-9e35-9ea0f4e609ce" containerID="72577f13889ad892c39941455aaf49bf8fec15e6b66a1d1e7e6ea5ef717a3d78" exitCode=0
May 28 15:08:09.924188 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:09.924174    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerDied","Data":"72577f13889ad892c39941455aaf49bf8fec15e6b66a1d1e7e6ea5ef717a3d78"}
May 28 15:08:10.928798 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:10.928766    2562 generic.go:358] "Generic (PLEG): container finished" podID="db277cdc-530e-4b95-9e35-9ea0f4e609ce" containerID="4a0167d72bc639aa68f67ab85888ede555cd55bd27784d7ec20bfd39cc412b86" exitCode=0
May 28 15:08:10.929466 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:10.928846    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerDied","Data":"4a0167d72bc639aa68f67ab85888ede555cd55bd27784d7ec20bfd39cc412b86"}
May 28 15:08:11.692743 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:11.692712    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:11.692743 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:11.692725    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:11.692962 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:11.692712    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:11.692962 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:11.692824    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:11.692962 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:11.692917    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:11.693077 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:11.693007    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:13.334322 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:13.334286    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:13.334778 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.334401    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:08:13.334778 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.334458    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:08:45.334439246 +0000 UTC m=+65.268112119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 15:08:13.435007 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:13.434974    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:13.435174 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.435133    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 15:08:13.435174 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.435155    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 15:08:13.435174 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.435165    2562 projected.go:194] Error preparing data for projected volume kube-api-access-ltvjf for pod openshift-network-diagnostics/network-check-target-dzrhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:08:13.435297 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.435227    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf podName:9823d4aa-3041-4335-8bf0-81aed53a65e7 nodeName:}" failed. No retries permitted until 2026-05-28 15:08:45.435212108 +0000 UTC m=+65.368884984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltvjf" (UniqueName: "kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf") pod "network-check-target-dzrhm" (UID: "9823d4aa-3041-4335-8bf0-81aed53a65e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 15:08:13.693377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:13.693350    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:13.693377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:13.693366    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:13.693596 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:13.693366    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:13.693596 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.693440    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzrhm" podUID="9823d4aa-3041-4335-8bf0-81aed53a65e7"
May 28 15:08:13.693596 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.693560    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:08:13.693734 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:13.693653    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bshc" podUID="0e9968b0-d208-489b-8213-a723d613a84a"
May 28 15:08:14.384480 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.384273    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeReady"
May 28 15:08:14.384889 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.384604    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 15:08:14.429432 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.429366    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r4x7t"]
May 28 15:08:14.432129 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.432106    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bgvhq"]
May 28 15:08:14.432299 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.432268    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:14.434219 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.434201    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.434744 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.434721    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 15:08:14.434836 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.434812    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 15:08:14.435113 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.435098    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5mwm\""
May 28 15:08:14.435185 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.435132    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 15:08:14.436739 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.436719    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b5hqh\""
May 28 15:08:14.436849 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.436720    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 15:08:14.437163 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.437144    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 15:08:14.440634 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.440611    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4x7t"]
May 28 15:08:14.443621 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.443594    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgvhq"]
May 28 15:08:14.545289 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.545261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27010090-9a69-4620-a81b-967332feec6b-tmp-dir\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.545417 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.545314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nvw5\" (UniqueName: \"kubernetes.io/projected/27010090-9a69-4620-a81b-967332feec6b-kube-api-access-7nvw5\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.545465 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.545427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27010090-9a69-4620-a81b-967332feec6b-config-volume\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.545513 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.545467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.545513 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.545498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:14.545611 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.545516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj5h7\" (UniqueName: \"kubernetes.io/projected/f895dd66-5bc8-4831-a999-fc429510924f-kube-api-access-jj5h7\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:14.646667 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.646642    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:14.646793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.646672    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj5h7\" (UniqueName: \"kubernetes.io/projected/f895dd66-5bc8-4831-a999-fc429510924f-kube-api-access-jj5h7\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:14.646793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.646703    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27010090-9a69-4620-a81b-967332feec6b-tmp-dir\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.646793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.646735    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nvw5\" (UniqueName: \"kubernetes.io/projected/27010090-9a69-4620-a81b-967332feec6b-kube-api-access-7nvw5\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.646793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.646777    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27010090-9a69-4620-a81b-967332feec6b-config-volume\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.647098 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:14.646800    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:14.647098 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.646810    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.647098 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:14.646878    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:08:15.146858247 +0000 UTC m=+35.080531131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:14.647098 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:14.646901    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:14.647098 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:14.646956    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:08:15.146940557 +0000 UTC m=+35.080613428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:14.647098 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.647094    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27010090-9a69-4620-a81b-967332feec6b-tmp-dir\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.647399 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.647382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27010090-9a69-4620-a81b-967332feec6b-config-volume\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.658011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.657991    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nvw5\" (UniqueName: \"kubernetes.io/projected/27010090-9a69-4620-a81b-967332feec6b-kube-api-access-7nvw5\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:14.658293 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:14.658270    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj5h7\" (UniqueName: \"kubernetes.io/projected/f895dd66-5bc8-4831-a999-fc429510924f-kube-api-access-jj5h7\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:15.150130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.150093    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:15.150312 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.150152    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:15.150312 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:15.150248    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:15.150431 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:15.150318    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:08:16.1503035 +0000 UTC m=+36.083976371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:15.150530 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:15.150248    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:15.150655 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:15.150590    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:08:16.150571158 +0000 UTC m=+36.084244044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:15.692733 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.692700    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:15.693172 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.692706    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:15.693172 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.692706    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:15.695550 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.695528    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xkj5\""
May 28 15:08:15.695717 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.695701    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 15:08:15.695816 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.695800    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 15:08:15.696900 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.696881    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 15:08:15.697044 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.696881    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wjkp\""
May 28 15:08:15.697044 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.696975    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 15:08:15.753911 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.753879    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:15.756588 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:15.756565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e9968b0-d208-489b-8213-a723d613a84a-original-pull-secret\") pod \"global-pull-secret-syncer-6bshc\" (UID: \"0e9968b0-d208-489b-8213-a723d613a84a\") " pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:16.010610 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:16.010529    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bshc"
May 28 15:08:16.156939 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:16.156895    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:16.157118 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:16.156964    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:16.157118 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:16.157109    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:16.157209 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:16.157170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:08:18.157155782 +0000 UTC m=+38.090828652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:16.157626 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:16.157595    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:16.157756 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:16.157655    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:08:18.157638386 +0000 UTC m=+38.091311284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:17.954042 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:17.953994    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6bshc"]
May 28 15:08:18.017618 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:08:18.017587    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9968b0_d208_489b_8213_a723d613a84a.slice/crio-358d7dcf0daa7e30c9a26faa3c424bf0add0e474211e8d4dba6a49a49f219a58 WatchSource:0}: Error finding container 358d7dcf0daa7e30c9a26faa3c424bf0add0e474211e8d4dba6a49a49f219a58: Status 404 returned error can't find the container with id 358d7dcf0daa7e30c9a26faa3c424bf0add0e474211e8d4dba6a49a49f219a58
May 28 15:08:18.171953 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:18.171782    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:18.172066 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:18.171985    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:18.172066 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:18.171939    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:18.172184 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:18.172103    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:08:22.172076904 +0000 UTC m=+42.105749790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:18.172184 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:18.172139    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:18.172184 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:18.172182    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:08:22.17216692 +0000 UTC m=+42.105839791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:18.945568 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:18.945529    2562 generic.go:358] "Generic (PLEG): container finished" podID="db277cdc-530e-4b95-9e35-9ea0f4e609ce" containerID="04f6f0dcf38cb0fcabab000dd782f8a6d7c157b5c24229c9d2f9ac10ee0f7ce7" exitCode=0
May 28 15:08:18.945763 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:18.945601    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerDied","Data":"04f6f0dcf38cb0fcabab000dd782f8a6d7c157b5c24229c9d2f9ac10ee0f7ce7"}
May 28 15:08:18.946693 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:18.946661    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6bshc" event={"ID":"0e9968b0-d208-489b-8213-a723d613a84a","Type":"ContainerStarted","Data":"358d7dcf0daa7e30c9a26faa3c424bf0add0e474211e8d4dba6a49a49f219a58"}
May 28 15:08:19.951896 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:19.951860    2562 generic.go:358] "Generic (PLEG): container finished" podID="db277cdc-530e-4b95-9e35-9ea0f4e609ce" containerID="45c2320c75f49d7441d5fd59a31b3744fa9d384287bd48d965b5e0bacafd9085" exitCode=0
May 28 15:08:19.952388 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:19.951936    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerDied","Data":"45c2320c75f49d7441d5fd59a31b3744fa9d384287bd48d965b5e0bacafd9085"}
May 28 15:08:20.957577 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:20.957537    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lshn" event={"ID":"db277cdc-530e-4b95-9e35-9ea0f4e609ce","Type":"ContainerStarted","Data":"052f6746ac9399f0a0c3d4ed8819777aa289ca3a117be995f112605f5bd37e5e"}
May 28 15:08:20.982193 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:20.981936    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7lshn" podStartSLOduration=4.925695574 podStartE2EDuration="40.981920068s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:07:41.996664166 +0000 UTC m=+1.930337037" lastFinishedPulling="2026-05-28 15:08:18.052888648 +0000 UTC m=+37.986561531" observedRunningTime="2026-05-28 15:08:20.98027981 +0000 UTC m=+40.913952716" watchObservedRunningTime="2026-05-28 15:08:20.981920068 +0000 UTC m=+40.915592963"
May 28 15:08:22.203092 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:22.203056    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:22.203493 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:22.203113    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:22.203493 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:22.203204    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:22.203493 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:22.203268    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:08:30.203252328 +0000 UTC m=+50.136925203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:22.203493 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:22.203297    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:22.203493 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:22.203362    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:08:30.20334481 +0000 UTC m=+50.137017698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:22.962641 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:22.962602    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6bshc" event={"ID":"0e9968b0-d208-489b-8213-a723d613a84a","Type":"ContainerStarted","Data":"5bc0e21f611072376928bc9710651ee83be9c5060f2a5fc99928b5247bbb8cce"}
May 28 15:08:22.977238 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:22.977195    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6bshc" podStartSLOduration=36.038915467 podStartE2EDuration="39.977181553s" podCreationTimestamp="2026-05-28 15:07:43 +0000 UTC" firstStartedPulling="2026-05-28 15:08:18.030568074 +0000 UTC m=+37.964240944" lastFinishedPulling="2026-05-28 15:08:21.968834157 +0000 UTC m=+41.902507030" observedRunningTime="2026-05-28 15:08:22.976825536 +0000 UTC m=+42.910498430" watchObservedRunningTime="2026-05-28 15:08:22.977181553 +0000 UTC m=+42.910854441"
May 28 15:08:30.255096 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:30.255053    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:30.255521 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:30.255112    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:30.255521 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:30.255204    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:30.255521 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:30.255239    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:30.255521 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:30.255269    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:08:46.255253476 +0000 UTC m=+66.188926348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:30.255521 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:30.255304    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:08:46.255287079 +0000 UTC m=+66.188959963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:40.938566 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:40.938537    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvd87"
May 28 15:08:45.347123 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.347083    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:08:45.349725 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.349704    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 15:08:45.357842 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:45.357820    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 15:08:45.357931 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:45.357888    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:09:49.357873412 +0000 UTC m=+129.291546290 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : secret "metrics-daemon-secret" not found
May 28 15:08:45.447939 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.447914    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:45.450847 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.450832    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 15:08:45.461221 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.461206    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 15:08:45.472680 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.472651    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltvjf\" (UniqueName: \"kubernetes.io/projected/9823d4aa-3041-4335-8bf0-81aed53a65e7-kube-api-access-ltvjf\") pod \"network-check-target-dzrhm\" (UID: \"9823d4aa-3041-4335-8bf0-81aed53a65e7\") " pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:45.707106 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.707088    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xkj5\""
May 28 15:08:45.715150 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.715136    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:45.828099 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:45.828074    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dzrhm"]
May 28 15:08:45.831679 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:08:45.831653    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9823d4aa_3041_4335_8bf0_81aed53a65e7.slice/crio-454f3d5cc0fc7669ca5bd30e3056044b7a6f7c2c3614676199eba4f7ca38fc6a WatchSource:0}: Error finding container 454f3d5cc0fc7669ca5bd30e3056044b7a6f7c2c3614676199eba4f7ca38fc6a: Status 404 returned error can't find the container with id 454f3d5cc0fc7669ca5bd30e3056044b7a6f7c2c3614676199eba4f7ca38fc6a
May 28 15:08:46.004086 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:46.004030    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dzrhm" event={"ID":"9823d4aa-3041-4335-8bf0-81aed53a65e7","Type":"ContainerStarted","Data":"454f3d5cc0fc7669ca5bd30e3056044b7a6f7c2c3614676199eba4f7ca38fc6a"}
May 28 15:08:46.352807 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:46.352735    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:08:46.352807 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:46.352787    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:08:46.353357 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:46.352886    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:08:46.353357 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:46.352895    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:08:46.353357 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:46.352936    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:09:18.352923548 +0000 UTC m=+98.286596419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:08:46.353357 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:08:46.352952    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:09:18.352942728 +0000 UTC m=+98.286615599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:08:47.384639 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.384605    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"]
May 28 15:08:47.393531 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.393509    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.398382 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.397311    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 15:08:47.398382 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.397605    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 15:08:47.398382 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.398299    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 15:08:47.398614 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.398438    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 15:08:47.400434 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.400403    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"]
May 28 15:08:47.562321 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.562277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e4095ed-6dca-483b-be28-bd8fbb19d366-tmp\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.562321 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.562318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42kwh\" (UniqueName: \"kubernetes.io/projected/2e4095ed-6dca-483b-be28-bd8fbb19d366-kube-api-access-42kwh\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.562561 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.562413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2e4095ed-6dca-483b-be28-bd8fbb19d366-klusterlet-config\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.663737 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.663655    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2e4095ed-6dca-483b-be28-bd8fbb19d366-klusterlet-config\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.663883 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.663745    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e4095ed-6dca-483b-be28-bd8fbb19d366-tmp\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.663883 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.663766    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42kwh\" (UniqueName: \"kubernetes.io/projected/2e4095ed-6dca-483b-be28-bd8fbb19d366-kube-api-access-42kwh\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.664357 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.664332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e4095ed-6dca-483b-be28-bd8fbb19d366-tmp\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.666641 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.666619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2e4095ed-6dca-483b-be28-bd8fbb19d366-klusterlet-config\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.672184 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.672159    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42kwh\" (UniqueName: \"kubernetes.io/projected/2e4095ed-6dca-483b-be28-bd8fbb19d366-kube-api-access-42kwh\") pod \"klusterlet-addon-workmgr-757f68578d-rbsrl\" (UID: \"2e4095ed-6dca-483b-be28-bd8fbb19d366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:47.708144 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:47.708119    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:48.679753 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:48.679715    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"]
May 28 15:08:48.682849 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:08:48.682823    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4095ed_6dca_483b_be28_bd8fbb19d366.slice/crio-04be609cbef0eeb42e980b56e16f89f2131657091b1ef0ffb903393d585469e8 WatchSource:0}: Error finding container 04be609cbef0eeb42e980b56e16f89f2131657091b1ef0ffb903393d585469e8: Status 404 returned error can't find the container with id 04be609cbef0eeb42e980b56e16f89f2131657091b1ef0ffb903393d585469e8
May 28 15:08:49.012166 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:49.012139    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dzrhm" event={"ID":"9823d4aa-3041-4335-8bf0-81aed53a65e7","Type":"ContainerStarted","Data":"c091b5dcf4819504acad1060eee6097de8bfad168f0705bc39218409411ed06a"}
May 28 15:08:49.012260 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:49.012233    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:08:49.013121 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:49.013100    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl" event={"ID":"2e4095ed-6dca-483b-be28-bd8fbb19d366","Type":"ContainerStarted","Data":"04be609cbef0eeb42e980b56e16f89f2131657091b1ef0ffb903393d585469e8"}
May 28 15:08:49.026337 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:49.026297    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dzrhm" podStartSLOduration=65.989091862 podStartE2EDuration="1m9.026285875s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:08:45.833448292 +0000 UTC m=+65.767121165" lastFinishedPulling="2026-05-28 15:08:48.870642308 +0000 UTC m=+68.804315178" observedRunningTime="2026-05-28 15:08:49.025751929 +0000 UTC m=+68.959424822" watchObservedRunningTime="2026-05-28 15:08:49.026285875 +0000 UTC m=+68.959958767"
May 28 15:08:54.025081 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:54.025044    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl" event={"ID":"2e4095ed-6dca-483b-be28-bd8fbb19d366","Type":"ContainerStarted","Data":"33d92212be5f96e2f26e5ca3d5a5b8853b829b7e1212a66591cc460b0cb0f4f5"}
May 28 15:08:54.025527 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:54.025232    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:54.026458 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:54.026438    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl"
May 28 15:08:54.041963 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:08:54.041927    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-757f68578d-rbsrl" podStartSLOduration=2.439826322 podStartE2EDuration="7.041913754s" podCreationTimestamp="2026-05-28 15:08:47 +0000 UTC" firstStartedPulling="2026-05-28 15:08:48.684846305 +0000 UTC m=+68.618519179" lastFinishedPulling="2026-05-28 15:08:53.286933737 +0000 UTC m=+73.220606611" observedRunningTime="2026-05-28 15:08:54.041742924 +0000 UTC m=+73.975415843" watchObservedRunningTime="2026-05-28 15:08:54.041913754 +0000 UTC m=+73.975586649"
May 28 15:09:18.361860 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:18.361808    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:09:18.362270 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:18.361883    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:09:18.362270 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:18.361952    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 15:09:18.362270 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:18.361959    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 15:09:18.362270 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:18.362058    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert podName:f895dd66-5bc8-4831-a999-fc429510924f nodeName:}" failed. No retries permitted until 2026-05-28 15:10:22.362004717 +0000 UTC m=+162.295677593 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert") pod "ingress-canary-r4x7t" (UID: "f895dd66-5bc8-4831-a999-fc429510924f") : secret "canary-serving-cert" not found
May 28 15:09:18.362270 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:18.362085    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls podName:27010090-9a69-4620-a81b-967332feec6b nodeName:}" failed. No retries permitted until 2026-05-28 15:10:22.362073497 +0000 UTC m=+162.295746368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls") pod "dns-default-bgvhq" (UID: "27010090-9a69-4620-a81b-967332feec6b") : secret "dns-default-metrics-tls" not found
May 28 15:09:20.017891 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:20.017859    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dzrhm"
May 28 15:09:34.205822 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.205793    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"]
May 28 15:09:34.210937 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.210919    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"
May 28 15:09:34.213303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.213285    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 15:09:34.214351 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.214322    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bqdtn\""
May 28 15:09:34.214472 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.214322    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 15:09:34.218229 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.218208    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"]
May 28 15:09:34.265740 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.265714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgrgr\" (UniqueName: \"kubernetes.io/projected/02b2d455-cd37-4197-b250-ce2d89d9e697-kube-api-access-hgrgr\") pod \"volume-data-source-validator-5cf8c89d64-j4wjw\" (UID: \"02b2d455-cd37-4197-b250-ce2d89d9e697\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"
May 28 15:09:34.307085 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.307061    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5zz9p"]
May 28 15:09:34.309431 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.309410    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.311746 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.311725    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 28 15:09:34.311865 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.311847    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 28 15:09:34.312070 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.312051    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 28 15:09:34.312162 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.312120    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 28 15:09:34.312218 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.312177    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ll9fb\""
May 28 15:09:34.318744 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.318722    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 28 15:09:34.320539 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.320518    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5zz9p"]
May 28 15:09:34.366416 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.366393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7c6207a-78ab-411d-9807-f768a724347b-trusted-ca\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.366517 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.366420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7c6207a-78ab-411d-9807-f768a724347b-config\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.366517 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.366457    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgrgr\" (UniqueName: \"kubernetes.io/projected/02b2d455-cd37-4197-b250-ce2d89d9e697-kube-api-access-hgrgr\") pod \"volume-data-source-validator-5cf8c89d64-j4wjw\" (UID: \"02b2d455-cd37-4197-b250-ce2d89d9e697\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"
May 28 15:09:34.366517 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.366497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c6207a-78ab-411d-9807-f768a724347b-serving-cert\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.366668 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.366557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5bb\" (UniqueName: \"kubernetes.io/projected/d7c6207a-78ab-411d-9807-f768a724347b-kube-api-access-hm5bb\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.373682 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.373658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgrgr\" (UniqueName: \"kubernetes.io/projected/02b2d455-cd37-4197-b250-ce2d89d9e697-kube-api-access-hgrgr\") pod \"volume-data-source-validator-5cf8c89d64-j4wjw\" (UID: \"02b2d455-cd37-4197-b250-ce2d89d9e697\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"
May 28 15:09:34.406309 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.406285    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"]
May 28 15:09:34.409104 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.409085    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-8rhk7"]
May 28 15:09:34.409232 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.409216    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.411455 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.411418    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 15:09:34.411539 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.411503    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 15:09:34.411539 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.411527    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 15:09:34.411643 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.411425    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.411643 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.411586    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vb27z\""
May 28 15:09:34.411744 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.411728    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 15:09:34.413751 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.413731    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 28 15:09:34.413853 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.413768    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 15:09:34.413853 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.413773    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fnvhs\""
May 28 15:09:34.414000 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.413987    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 28 15:09:34.414070 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.414002    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 15:09:34.419360 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.419340    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 28 15:09:34.420623 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.420586    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"]
May 28 15:09:34.421455 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.421439    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-8rhk7"]
May 28 15:09:34.467281 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467228    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c6207a-78ab-411d-9807-f768a724347b-serving-cert\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.467281 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467256    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5bb\" (UniqueName: \"kubernetes.io/projected/d7c6207a-78ab-411d-9807-f768a724347b-kube-api-access-hm5bb\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.467281 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa9293a7-d63f-415d-8a43-a82e1053bcb5-snapshots\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa9293a7-d63f-415d-8a43-a82e1053bcb5-serving-cert\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a34797c-99b8-4bfb-bd86-40c00ef98207-serving-cert\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a34797c-99b8-4bfb-bd86-40c00ef98207-config\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa9293a7-d63f-415d-8a43-a82e1053bcb5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa9293a7-d63f-415d-8a43-a82e1053bcb5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z4vv\" (UniqueName: \"kubernetes.io/projected/fa9293a7-d63f-415d-8a43-a82e1053bcb5-kube-api-access-9z4vv\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467462    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7c6207a-78ab-411d-9807-f768a724347b-trusted-ca\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.467492 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w44vg\" (UniqueName: \"kubernetes.io/projected/1a34797c-99b8-4bfb-bd86-40c00ef98207-kube-api-access-w44vg\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.467809 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7c6207a-78ab-411d-9807-f768a724347b-config\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.467809 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.467596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9293a7-d63f-415d-8a43-a82e1053bcb5-tmp\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.468264 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.468242    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7c6207a-78ab-411d-9807-f768a724347b-config\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.468398 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.468381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7c6207a-78ab-411d-9807-f768a724347b-trusted-ca\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.469637 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.469621    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c6207a-78ab-411d-9807-f768a724347b-serving-cert\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.475386 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.475367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5bb\" (UniqueName: \"kubernetes.io/projected/d7c6207a-78ab-411d-9807-f768a724347b-kube-api-access-hm5bb\") pod \"console-operator-76dff48d59-5zz9p\" (UID: \"d7c6207a-78ab-411d-9807-f768a724347b\") " pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.520274 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.520249    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"
May 28 15:09:34.568636 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568603    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w44vg\" (UniqueName: \"kubernetes.io/projected/1a34797c-99b8-4bfb-bd86-40c00ef98207-kube-api-access-w44vg\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.568743 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568667    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9293a7-d63f-415d-8a43-a82e1053bcb5-tmp\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.568743 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568725    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa9293a7-d63f-415d-8a43-a82e1053bcb5-snapshots\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.568833 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568753    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa9293a7-d63f-415d-8a43-a82e1053bcb5-serving-cert\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.568833 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568780    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a34797c-99b8-4bfb-bd86-40c00ef98207-serving-cert\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.568833 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568810    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a34797c-99b8-4bfb-bd86-40c00ef98207-config\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.568999 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568836    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa9293a7-d63f-415d-8a43-a82e1053bcb5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.568999 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568863    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa9293a7-d63f-415d-8a43-a82e1053bcb5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.568999 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.568891    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z4vv\" (UniqueName: \"kubernetes.io/projected/fa9293a7-d63f-415d-8a43-a82e1053bcb5-kube-api-access-9z4vv\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.569211 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.569169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa9293a7-d63f-415d-8a43-a82e1053bcb5-tmp\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.569834 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.569768    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa9293a7-d63f-415d-8a43-a82e1053bcb5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.569834 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.569774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a34797c-99b8-4bfb-bd86-40c00ef98207-config\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.569988 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.569955    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa9293a7-d63f-415d-8a43-a82e1053bcb5-snapshots\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.570630 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.570607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa9293a7-d63f-415d-8a43-a82e1053bcb5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.571992 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.571967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a34797c-99b8-4bfb-bd86-40c00ef98207-serving-cert\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.572223 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.572184    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa9293a7-d63f-415d-8a43-a82e1053bcb5-serving-cert\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.577615 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.577369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w44vg\" (UniqueName: \"kubernetes.io/projected/1a34797c-99b8-4bfb-bd86-40c00ef98207-kube-api-access-w44vg\") pod \"service-ca-operator-57b5b68b8-v8wpr\" (UID: \"1a34797c-99b8-4bfb-bd86-40c00ef98207\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.577713 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.577638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z4vv\" (UniqueName: \"kubernetes.io/projected/fa9293a7-d63f-415d-8a43-a82e1053bcb5-kube-api-access-9z4vv\") pod \"insights-operator-78bdfb888c-8rhk7\" (UID: \"fa9293a7-d63f-415d-8a43-a82e1053bcb5\") " pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.618960 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.618937    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:34.641575 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.641553    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw"]
May 28 15:09:34.644530 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:09:34.644505    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b2d455_cd37_4197_b250_ce2d89d9e697.slice/crio-78d5f2513f946794e10027fb5125c0b4beefee231ec3ef3a82781f5732d5c6bc WatchSource:0}: Error finding container 78d5f2513f946794e10027fb5125c0b4beefee231ec3ef3a82781f5732d5c6bc: Status 404 returned error can't find the container with id 78d5f2513f946794e10027fb5125c0b4beefee231ec3ef3a82781f5732d5c6bc
May 28 15:09:34.718880 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.718817    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"
May 28 15:09:34.725568 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.725545    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7"
May 28 15:09:34.736124 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.736099    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5zz9p"]
May 28 15:09:34.739736 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:09:34.739711    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c6207a_78ab_411d_9807_f768a724347b.slice/crio-819ceab6bcb223edbe3d28a67b25457ca8039ce9b1aceece84fce7fc6b09d29a WatchSource:0}: Error finding container 819ceab6bcb223edbe3d28a67b25457ca8039ce9b1aceece84fce7fc6b09d29a: Status 404 returned error can't find the container with id 819ceab6bcb223edbe3d28a67b25457ca8039ce9b1aceece84fce7fc6b09d29a
May 28 15:09:34.844710 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.844673    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr"]
May 28 15:09:34.847477 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:09:34.847451    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a34797c_99b8_4bfb_bd86_40c00ef98207.slice/crio-e5ee205d56aa1a918ecd6278a15c5043fadee95cf25226b021dd9418a70cbb26 WatchSource:0}: Error finding container e5ee205d56aa1a918ecd6278a15c5043fadee95cf25226b021dd9418a70cbb26: Status 404 returned error can't find the container with id e5ee205d56aa1a918ecd6278a15c5043fadee95cf25226b021dd9418a70cbb26
May 28 15:09:34.859868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:34.859846    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-8rhk7"]
May 28 15:09:34.862473 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:09:34.862451    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9293a7_d63f_415d_8a43_a82e1053bcb5.slice/crio-a469e10dfb5129e30b3f51e66d672ee01a8ddd5bed6bdb6544f84a9005966336 WatchSource:0}: Error finding container a469e10dfb5129e30b3f51e66d672ee01a8ddd5bed6bdb6544f84a9005966336: Status 404 returned error can't find the container with id a469e10dfb5129e30b3f51e66d672ee01a8ddd5bed6bdb6544f84a9005966336
May 28 15:09:35.093979 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:35.093917    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr" event={"ID":"1a34797c-99b8-4bfb-bd86-40c00ef98207","Type":"ContainerStarted","Data":"e5ee205d56aa1a918ecd6278a15c5043fadee95cf25226b021dd9418a70cbb26"}
May 28 15:09:35.094959 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:35.094940    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" event={"ID":"d7c6207a-78ab-411d-9807-f768a724347b","Type":"ContainerStarted","Data":"819ceab6bcb223edbe3d28a67b25457ca8039ce9b1aceece84fce7fc6b09d29a"}
May 28 15:09:35.095901 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:35.095883    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw" event={"ID":"02b2d455-cd37-4197-b250-ce2d89d9e697","Type":"ContainerStarted","Data":"78d5f2513f946794e10027fb5125c0b4beefee231ec3ef3a82781f5732d5c6bc"}
May 28 15:09:35.096853 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:35.096829    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7" event={"ID":"fa9293a7-d63f-415d-8a43-a82e1053bcb5","Type":"ContainerStarted","Data":"a469e10dfb5129e30b3f51e66d672ee01a8ddd5bed6bdb6544f84a9005966336"}
May 28 15:09:38.104519 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.104486    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw" event={"ID":"02b2d455-cd37-4197-b250-ce2d89d9e697","Type":"ContainerStarted","Data":"ab473000fae3b880500e087a7053c3b78c44fc46c1251688b03733e01edf53d2"}
May 28 15:09:38.106675 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.106214    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7" event={"ID":"fa9293a7-d63f-415d-8a43-a82e1053bcb5","Type":"ContainerStarted","Data":"fa1fc3eb4bc31f5b61d446f472ee1105de786fd2a77f2e72cdf6cf1b7d3cd847"}
May 28 15:09:38.111527 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.111495    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr" event={"ID":"1a34797c-99b8-4bfb-bd86-40c00ef98207","Type":"ContainerStarted","Data":"8f149be1d0dfdd189714c053b1cbc23ba17f3f71276be550d99fa40fb2a22055"}
May 28 15:09:38.113290 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.113273    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/0.log"
May 28 15:09:38.113377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.113308    2562 generic.go:358] "Generic (PLEG): container finished" podID="d7c6207a-78ab-411d-9807-f768a724347b" containerID="10467d47ee44f6aa4b43996900c10fccca4c47a50b8288d641120c1ee87cce91" exitCode=255
May 28 15:09:38.113377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.113334    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" event={"ID":"d7c6207a-78ab-411d-9807-f768a724347b","Type":"ContainerDied","Data":"10467d47ee44f6aa4b43996900c10fccca4c47a50b8288d641120c1ee87cce91"}
May 28 15:09:38.113604 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.113587    2562 scope.go:117] "RemoveContainer" containerID="10467d47ee44f6aa4b43996900c10fccca4c47a50b8288d641120c1ee87cce91"
May 28 15:09:38.119427 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.119392    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-j4wjw" podStartSLOduration=0.833420388 podStartE2EDuration="4.119383178s" podCreationTimestamp="2026-05-28 15:09:34 +0000 UTC" firstStartedPulling="2026-05-28 15:09:34.646248599 +0000 UTC m=+114.579921470" lastFinishedPulling="2026-05-28 15:09:37.932211389 +0000 UTC m=+117.865884260" observedRunningTime="2026-05-28 15:09:38.118295633 +0000 UTC m=+118.051968527" watchObservedRunningTime="2026-05-28 15:09:38.119383178 +0000 UTC m=+118.053056070"
May 28 15:09:38.132459 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.132423    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7" podStartSLOduration=1.061691037 podStartE2EDuration="4.132414334s" podCreationTimestamp="2026-05-28 15:09:34 +0000 UTC" firstStartedPulling="2026-05-28 15:09:34.864263886 +0000 UTC m=+114.797936756" lastFinishedPulling="2026-05-28 15:09:37.934987173 +0000 UTC m=+117.868660053" observedRunningTime="2026-05-28 15:09:38.131933065 +0000 UTC m=+118.065605960" watchObservedRunningTime="2026-05-28 15:09:38.132414334 +0000 UTC m=+118.066087256"
May 28 15:09:38.173949 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.173908    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr" podStartSLOduration=1.085584988 podStartE2EDuration="4.173896284s" podCreationTimestamp="2026-05-28 15:09:34 +0000 UTC" firstStartedPulling="2026-05-28 15:09:34.849459406 +0000 UTC m=+114.783132276" lastFinishedPulling="2026-05-28 15:09:37.937770683 +0000 UTC m=+117.871443572" observedRunningTime="2026-05-28 15:09:38.173724853 +0000 UTC m=+118.107397747" watchObservedRunningTime="2026-05-28 15:09:38.173896284 +0000 UTC m=+118.107569178"
May 28 15:09:38.695831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.695801    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"]
May 28 15:09:38.698536 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.698521    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"
May 28 15:09:38.700954 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.700929    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 15:09:38.701876 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.701858    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 15:09:38.701986 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.701899    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hcn6p\""
May 28 15:09:38.707387 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.707365    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"]
May 28 15:09:38.802602 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.802572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftpmm\" (UniqueName: \"kubernetes.io/projected/d6307546-6890-4b00-83c9-7a01cf66a4e0-kube-api-access-ftpmm\") pod \"migrator-b985f5d89-lg2c9\" (UID: \"d6307546-6890-4b00-83c9-7a01cf66a4e0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"
May 28 15:09:38.903046 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.903002    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftpmm\" (UniqueName: \"kubernetes.io/projected/d6307546-6890-4b00-83c9-7a01cf66a4e0-kube-api-access-ftpmm\") pod \"migrator-b985f5d89-lg2c9\" (UID: \"d6307546-6890-4b00-83c9-7a01cf66a4e0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"
May 28 15:09:38.911088 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:38.911066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftpmm\" (UniqueName: \"kubernetes.io/projected/d6307546-6890-4b00-83c9-7a01cf66a4e0-kube-api-access-ftpmm\") pod \"migrator-b985f5d89-lg2c9\" (UID: \"d6307546-6890-4b00-83c9-7a01cf66a4e0\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"
May 28 15:09:39.007293 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.007232    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"
May 28 15:09:39.117817 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.117794    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:09:39.118227 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.118201    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/0.log"
May 28 15:09:39.118285 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.118237    2562 generic.go:358] "Generic (PLEG): container finished" podID="d7c6207a-78ab-411d-9807-f768a724347b" containerID="20266419e7c83d84e94ad32de51005f1ed1fc9cd64e819a142da0a94b4e69043" exitCode=255
May 28 15:09:39.118398 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.118371    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" event={"ID":"d7c6207a-78ab-411d-9807-f768a724347b","Type":"ContainerDied","Data":"20266419e7c83d84e94ad32de51005f1ed1fc9cd64e819a142da0a94b4e69043"}
May 28 15:09:39.118520 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.118438    2562 scope.go:117] "RemoveContainer" containerID="10467d47ee44f6aa4b43996900c10fccca4c47a50b8288d641120c1ee87cce91"
May 28 15:09:39.118816 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.118793    2562 scope.go:117] "RemoveContainer" containerID="20266419e7c83d84e94ad32de51005f1ed1fc9cd64e819a142da0a94b4e69043"
May 28 15:09:39.119007 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:39.118979    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5zz9p_openshift-console-operator(d7c6207a-78ab-411d-9807-f768a724347b)\"" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" podUID="d7c6207a-78ab-411d-9807-f768a724347b"
May 28 15:09:39.139322 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:39.139300    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9"]
May 28 15:09:39.142334 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:09:39.142307    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6307546_6890_4b00_83c9_7a01cf66a4e0.slice/crio-c341ffa35e13cadfb521a2f6fe9de2ca2d4f60f98b3aa39b3a8eafb3b99f172b WatchSource:0}: Error finding container c341ffa35e13cadfb521a2f6fe9de2ca2d4f60f98b3aa39b3a8eafb3b99f172b: Status 404 returned error can't find the container with id c341ffa35e13cadfb521a2f6fe9de2ca2d4f60f98b3aa39b3a8eafb3b99f172b
May 28 15:09:40.121586 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:40.121560    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:09:40.122014 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:40.121915    2562 scope.go:117] "RemoveContainer" containerID="20266419e7c83d84e94ad32de51005f1ed1fc9cd64e819a142da0a94b4e69043"
May 28 15:09:40.122171 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:40.122149    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5zz9p_openshift-console-operator(d7c6207a-78ab-411d-9807-f768a724347b)\"" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" podUID="d7c6207a-78ab-411d-9807-f768a724347b"
May 28 15:09:40.122658 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:40.122634    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9" event={"ID":"d6307546-6890-4b00-83c9-7a01cf66a4e0","Type":"ContainerStarted","Data":"c341ffa35e13cadfb521a2f6fe9de2ca2d4f60f98b3aa39b3a8eafb3b99f172b"}
May 28 15:09:41.127130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.127094    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9" event={"ID":"d6307546-6890-4b00-83c9-7a01cf66a4e0","Type":"ContainerStarted","Data":"8db83ecd022a8d1f01abef4f52d12aaaa634be50a842a733fcaa7367dceee8a2"}
May 28 15:09:41.127130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.127133    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9" event={"ID":"d6307546-6890-4b00-83c9-7a01cf66a4e0","Type":"ContainerStarted","Data":"f5da3a98eb15112cfc4e3e23b676117087e09bf3e5b53d8428c4af302a59b1e2"}
May 28 15:09:41.141571 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.141498    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-lg2c9" podStartSLOduration=1.7758234050000001 podStartE2EDuration="3.141483997s" podCreationTimestamp="2026-05-28 15:09:38 +0000 UTC" firstStartedPulling="2026-05-28 15:09:39.144630456 +0000 UTC m=+119.078303334" lastFinishedPulling="2026-05-28 15:09:40.510291037 +0000 UTC m=+120.443963926" observedRunningTime="2026-05-28 15:09:41.141260479 +0000 UTC m=+121.074933372" watchObservedRunningTime="2026-05-28 15:09:41.141483997 +0000 UTC m=+121.075156892"
May 28 15:09:41.782229 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.782199    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zt5fj"]
May 28 15:09:41.785190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.785174    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.787574 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.787548    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 15:09:41.787687 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.787598    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wsm7s\""
May 28 15:09:41.788259 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.787848    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 15:09:41.788259 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.788001    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 15:09:41.788259 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.788191    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 15:09:41.793662 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.793637    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zt5fj"]
May 28 15:09:41.830220 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.830195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52n8n\" (UniqueName: \"kubernetes.io/projected/c4e255c7-028e-478a-825c-8a75fa6619cc-kube-api-access-52n8n\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.830310 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.830238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c4e255c7-028e-478a-825c-8a75fa6619cc-signing-cabundle\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.830310 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.830273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c4e255c7-028e-478a-825c-8a75fa6619cc-signing-key\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.931402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.931377    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c4e255c7-028e-478a-825c-8a75fa6619cc-signing-key\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.931512 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.931431    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52n8n\" (UniqueName: \"kubernetes.io/projected/c4e255c7-028e-478a-825c-8a75fa6619cc-kube-api-access-52n8n\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.931585 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.931566    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c4e255c7-028e-478a-825c-8a75fa6619cc-signing-cabundle\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.932128 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.932111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c4e255c7-028e-478a-825c-8a75fa6619cc-signing-cabundle\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.933826 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.933807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c4e255c7-028e-478a-825c-8a75fa6619cc-signing-key\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:41.939128 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:41.939111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52n8n\" (UniqueName: \"kubernetes.io/projected/c4e255c7-028e-478a-825c-8a75fa6619cc-kube-api-access-52n8n\") pod \"service-ca-67d667c7d-zt5fj\" (UID: \"c4e255c7-028e-478a-825c-8a75fa6619cc\") " pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:42.096769 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:42.096718    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-zt5fj"
May 28 15:09:42.226251 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:42.226202    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zt5fj"]
May 28 15:09:42.229315 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:09:42.229291    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e255c7_028e_478a_825c_8a75fa6619cc.slice/crio-2d1c04add7299f0d3d7a75cbdb73f4c25832bd9a1f6ecc70cd4235b645bc3ec0 WatchSource:0}: Error finding container 2d1c04add7299f0d3d7a75cbdb73f4c25832bd9a1f6ecc70cd4235b645bc3ec0: Status 404 returned error can't find the container with id 2d1c04add7299f0d3d7a75cbdb73f4c25832bd9a1f6ecc70cd4235b645bc3ec0
May 28 15:09:42.709725 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:42.709701    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v79m4_a4648f74-0eab-4362-b95c-f41f3ac3253e/dns-node-resolver/0.log"
May 28 15:09:43.133533 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:43.133498    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-zt5fj" event={"ID":"c4e255c7-028e-478a-825c-8a75fa6619cc","Type":"ContainerStarted","Data":"a8ffa33e3e8f4ffe248c77c7c968f19a140ec099d29de6c0aa7ff4cf758bc283"}
May 28 15:09:43.133533 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:43.133530    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-zt5fj" event={"ID":"c4e255c7-028e-478a-825c-8a75fa6619cc","Type":"ContainerStarted","Data":"2d1c04add7299f0d3d7a75cbdb73f4c25832bd9a1f6ecc70cd4235b645bc3ec0"}
May 28 15:09:43.149406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:43.149365    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-zt5fj" podStartSLOduration=2.149351605 podStartE2EDuration="2.149351605s" podCreationTimestamp="2026-05-28 15:09:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:09:43.148803601 +0000 UTC m=+123.082476508" watchObservedRunningTime="2026-05-28 15:09:43.149351605 +0000 UTC m=+123.083024504"
May 28 15:09:43.508307 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:43.508229    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-df95z_6464f135-aaa3-4d79-b4ae-4e8d462333a3/node-ca/0.log"
May 28 15:09:44.619818 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:44.619789    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:44.619818 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:44.619819    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:09:44.620244 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:44.620133    2562 scope.go:117] "RemoveContainer" containerID="20266419e7c83d84e94ad32de51005f1ed1fc9cd64e819a142da0a94b4e69043"
May 28 15:09:44.620289 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:44.620272    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5zz9p_openshift-console-operator(d7c6207a-78ab-411d-9807-f768a724347b)\"" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" podUID="d7c6207a-78ab-411d-9807-f768a724347b"
May 28 15:09:44.708564 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:44.708534    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-lg2c9_d6307546-6890-4b00-83c9-7a01cf66a4e0/migrator/0.log"
May 28 15:09:44.908591 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:44.908531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-lg2c9_d6307546-6890-4b00-83c9-7a01cf66a4e0/graceful-termination/0.log"
May 28 15:09:49.385403 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:49.385368    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:09:49.385756 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:49.385497    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 15:09:49.385756 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:09:49.385557    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs podName:523e2e5d-3908-45f1-bdad-676bee5d9082 nodeName:}" failed. No retries permitted until 2026-05-28 15:11:51.385542546 +0000 UTC m=+251.319215417 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs") pod "network-metrics-daemon-nvz75" (UID: "523e2e5d-3908-45f1-bdad-676bee5d9082") : secret "metrics-daemon-secret" not found
May 28 15:09:59.693267 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:09:59.693240    2562 scope.go:117] "RemoveContainer" containerID="20266419e7c83d84e94ad32de51005f1ed1fc9cd64e819a142da0a94b4e69043"
May 28 15:10:00.177120 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:00.177098    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:10:00.177256 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:00.177140    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" event={"ID":"d7c6207a-78ab-411d-9807-f768a724347b","Type":"ContainerStarted","Data":"c92d3e332f3286894119832a92a8dc79b73eccd9add621399efdff9c7ae1f0b9"}
May 28 15:10:00.177493 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:00.177466    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:10:00.240469 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:00.240438    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p"
May 28 15:10:00.256944 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:00.256903    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-5zz9p" podStartSLOduration=23.066669634 podStartE2EDuration="26.256891304s" podCreationTimestamp="2026-05-28 15:09:34 +0000 UTC" firstStartedPulling="2026-05-28 15:09:34.742274749 +0000 UTC m=+114.675947829" lastFinishedPulling="2026-05-28 15:09:37.932496612 +0000 UTC m=+117.866169499" observedRunningTime="2026-05-28 15:10:00.192463386 +0000 UTC m=+140.126136280" watchObservedRunningTime="2026-05-28 15:10:00.256891304 +0000 UTC m=+140.190564196"
May 28 15:10:01.826374 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.826343    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-85qfj"]
May 28 15:10:01.829585 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.829564    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:01.834138 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.834094    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 15:10:01.834263 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.834246    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 15:10:01.835167 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.835149    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nrcdd\""
May 28 15:10:01.843408 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.843378    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-85qfj"]
May 28 15:10:01.933450 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.933412    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-778f78ff99-pz5z2"]
May 28 15:10:01.936462 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.936442    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:01.939001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.938977    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 15:10:01.939246 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.939171    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7pvbk\""
May 28 15:10:01.939338 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.939305    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 15:10:01.939515 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.939485    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 15:10:01.944283 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.944264    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 15:10:01.958116 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.958096    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-778f78ff99-pz5z2"]
May 28 15:10:01.978110 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.978091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-data-volume\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:01.978197 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.978122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:01.978197 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.978157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-crio-socket\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:01.978197 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.978195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkj5g\" (UniqueName: \"kubernetes.io/projected/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-kube-api-access-hkj5g\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:01.978310 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:01.978215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079291 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079233    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079291 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-bound-sa-token\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079456 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p975b\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-kube-api-access-p975b\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079456 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0faba5ee-7420-4db7-8ead-74cacb660bad-trusted-ca\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079561 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079479    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-data-volume\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079561 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0faba5ee-7420-4db7-8ead-74cacb660bad-ca-trust-extracted\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079665 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0faba5ee-7420-4db7-8ead-74cacb660bad-registry-certificates\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079665 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079618    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079753 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079700    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-crio-socket\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079813 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-registry-tls\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079813 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079793    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkj5g\" (UniqueName: \"kubernetes.io/projected/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-kube-api-access-hkj5g\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079813 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-data-volume\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079954 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0faba5ee-7420-4db7-8ead-74cacb660bad-installation-pull-secrets\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079954 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-crio-socket\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.079954 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0faba5ee-7420-4db7-8ead-74cacb660bad-image-registry-private-configuration\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.079954 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.079935    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.082067 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.082049    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.089841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.089818    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkj5g\" (UniqueName: \"kubernetes.io/projected/5a218a10-01e2-4a25-9c7f-47bd0668d5f0-kube-api-access-hkj5g\") pod \"insights-runtime-extractor-85qfj\" (UID: \"5a218a10-01e2-4a25-9c7f-47bd0668d5f0\") " pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.138436 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.138417    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85qfj"
May 28 15:10:02.180608 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180582    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0faba5ee-7420-4db7-8ead-74cacb660bad-trusted-ca\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180773 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0faba5ee-7420-4db7-8ead-74cacb660bad-ca-trust-extracted\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180773 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0faba5ee-7420-4db7-8ead-74cacb660bad-registry-certificates\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180773 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180743    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-registry-tls\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180928 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180770    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0faba5ee-7420-4db7-8ead-74cacb660bad-installation-pull-secrets\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180928 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180802    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0faba5ee-7420-4db7-8ead-74cacb660bad-image-registry-private-configuration\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180928 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180860    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-bound-sa-token\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.180928 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.180891    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p975b\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-kube-api-access-p975b\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.181154 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.181138    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0faba5ee-7420-4db7-8ead-74cacb660bad-ca-trust-extracted\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.182099 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.181637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0faba5ee-7420-4db7-8ead-74cacb660bad-registry-certificates\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.182099 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.181747    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0faba5ee-7420-4db7-8ead-74cacb660bad-trusted-ca\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.184244 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.183927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0faba5ee-7420-4db7-8ead-74cacb660bad-installation-pull-secrets\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.184366 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.184317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-registry-tls\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.184856 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.184727    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0faba5ee-7420-4db7-8ead-74cacb660bad-image-registry-private-configuration\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.193506 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.193480    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-bound-sa-token\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.193868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.193848    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p975b\" (UniqueName: \"kubernetes.io/projected/0faba5ee-7420-4db7-8ead-74cacb660bad-kube-api-access-p975b\") pod \"image-registry-778f78ff99-pz5z2\" (UID: \"0faba5ee-7420-4db7-8ead-74cacb660bad\") " pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.246411 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.246387    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:02.267575 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.267157    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-85qfj"]
May 28 15:10:02.374045 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:02.373996    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-778f78ff99-pz5z2"]
May 28 15:10:02.376471 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:02.376443    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0faba5ee_7420_4db7_8ead_74cacb660bad.slice/crio-e33b74e4f3bd1556b4b019b6bf4c5e955a9704efd07e4a0ebd39eb61e4360814 WatchSource:0}: Error finding container e33b74e4f3bd1556b4b019b6bf4c5e955a9704efd07e4a0ebd39eb61e4360814: Status 404 returned error can't find the container with id e33b74e4f3bd1556b4b019b6bf4c5e955a9704efd07e4a0ebd39eb61e4360814
May 28 15:10:03.185054 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.184970    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85qfj" event={"ID":"5a218a10-01e2-4a25-9c7f-47bd0668d5f0","Type":"ContainerStarted","Data":"7ab7a8b2a5094a9b8370f26b402fb61aa684c1f6d59992f677f8c8b9ea18d790"}
May 28 15:10:03.185054 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.185015    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85qfj" event={"ID":"5a218a10-01e2-4a25-9c7f-47bd0668d5f0","Type":"ContainerStarted","Data":"a657d59c9612cf0b6e7a9927d08c2a0f661c8b03500d223421ac150b9a247aa8"}
May 28 15:10:03.185054 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.185047    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85qfj" event={"ID":"5a218a10-01e2-4a25-9c7f-47bd0668d5f0","Type":"ContainerStarted","Data":"d2b5a8b5f7b2044e0d7f48e242832b4cd3d2da8150e96b336b66c691aa837f3e"}
May 28 15:10:03.186135 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.186115    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" event={"ID":"0faba5ee-7420-4db7-8ead-74cacb660bad","Type":"ContainerStarted","Data":"8cbc8f7eed9b314442c17700e0ada59535fb9efcc3811eefdbce8026eab722bb"}
May 28 15:10:03.186199 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.186142    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" event={"ID":"0faba5ee-7420-4db7-8ead-74cacb660bad","Type":"ContainerStarted","Data":"e33b74e4f3bd1556b4b019b6bf4c5e955a9704efd07e4a0ebd39eb61e4360814"}
May 28 15:10:03.186260 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.186249    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:03.203063 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:03.203009    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podStartSLOduration=2.202998078 podStartE2EDuration="2.202998078s" podCreationTimestamp="2026-05-28 15:10:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:10:03.201995654 +0000 UTC m=+143.135668549" watchObservedRunningTime="2026-05-28 15:10:03.202998078 +0000 UTC m=+143.136670998"
May 28 15:10:05.193055 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:05.193005    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85qfj" event={"ID":"5a218a10-01e2-4a25-9c7f-47bd0668d5f0","Type":"ContainerStarted","Data":"dd21205c2b6cf43c052b00380fecf75f6f377058f0758f61d744634a0c74649d"}
May 28 15:10:05.211408 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:05.211365    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-85qfj" podStartSLOduration=1.9767848620000001 podStartE2EDuration="4.211350857s" podCreationTimestamp="2026-05-28 15:10:01 +0000 UTC" firstStartedPulling="2026-05-28 15:10:02.325864381 +0000 UTC m=+142.259537259" lastFinishedPulling="2026-05-28 15:10:04.560430369 +0000 UTC m=+144.494103254" observedRunningTime="2026-05-28 15:10:05.210419354 +0000 UTC m=+145.144092248" watchObservedRunningTime="2026-05-28 15:10:05.211350857 +0000 UTC m=+145.145023751"
May 28 15:10:17.445562 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:10:17.445518    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-r4x7t" podUID="f895dd66-5bc8-4831-a999-fc429510924f"
May 28 15:10:17.450686 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:10:17.450660    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgvhq" podUID="27010090-9a69-4620-a81b-967332feec6b"
May 28 15:10:18.222465 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:18.222440    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:10:18.222609 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:18.222440    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgvhq"
May 28 15:10:18.716161 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:10:18.716126    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nvz75" podUID="523e2e5d-3908-45f1-bdad-676bee5d9082"
May 28 15:10:22.251776 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.251684    2562 patch_prober.go:28] interesting pod/image-registry-778f78ff99-pz5z2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 15:10:22.251776 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.251744    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:10:22.424908 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.424868    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:10:22.425113 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.424929    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:10:22.427494 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.427464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27010090-9a69-4620-a81b-967332feec6b-metrics-tls\") pod \"dns-default-bgvhq\" (UID: \"27010090-9a69-4620-a81b-967332feec6b\") " pod="openshift-dns/dns-default-bgvhq"
May 28 15:10:22.427602 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.427502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f895dd66-5bc8-4831-a999-fc429510924f-cert\") pod \"ingress-canary-r4x7t\" (UID: \"f895dd66-5bc8-4831-a999-fc429510924f\") " pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:10:22.725511 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.725477    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5mwm\""
May 28 15:10:22.726409 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.726392    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b5hqh\""
May 28 15:10:22.733361 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.733345    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgvhq"
May 28 15:10:22.733459 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.733416    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4x7t"
May 28 15:10:22.870594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.870563    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgvhq"]
May 28 15:10:22.873915 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:22.873890    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27010090_9a69_4620_a81b_967332feec6b.slice/crio-1501b732ae5a5d9c521ccb264163fe1ed33533df2ace67bebf0c83184adf2c29 WatchSource:0}: Error finding container 1501b732ae5a5d9c521ccb264163fe1ed33533df2ace67bebf0c83184adf2c29: Status 404 returned error can't find the container with id 1501b732ae5a5d9c521ccb264163fe1ed33533df2ace67bebf0c83184adf2c29
May 28 15:10:22.883739 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:22.883699    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4x7t"]
May 28 15:10:22.886146 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:22.886126    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf895dd66_5bc8_4831_a999_fc429510924f.slice/crio-75e7a9b45e4e54b41b686fc1e6ee5d7c21060fcc75844b72ee4847f0de1758b8 WatchSource:0}: Error finding container 75e7a9b45e4e54b41b686fc1e6ee5d7c21060fcc75844b72ee4847f0de1758b8: Status 404 returned error can't find the container with id 75e7a9b45e4e54b41b686fc1e6ee5d7c21060fcc75844b72ee4847f0de1758b8
May 28 15:10:23.235993 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:23.235941    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgvhq" event={"ID":"27010090-9a69-4620-a81b-967332feec6b","Type":"ContainerStarted","Data":"1501b732ae5a5d9c521ccb264163fe1ed33533df2ace67bebf0c83184adf2c29"}
May 28 15:10:23.237184 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:23.237155    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4x7t" event={"ID":"f895dd66-5bc8-4831-a999-fc429510924f","Type":"ContainerStarted","Data":"75e7a9b45e4e54b41b686fc1e6ee5d7c21060fcc75844b72ee4847f0de1758b8"}
May 28 15:10:24.193147 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:24.193114    2562 patch_prober.go:28] interesting pod/image-registry-778f78ff99-pz5z2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 15:10:24.193485 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:24.193171    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:10:24.242313 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:24.242284    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgvhq" event={"ID":"27010090-9a69-4620-a81b-967332feec6b","Type":"ContainerStarted","Data":"9053ea78827a09c3d0f94e946b9f58d04090f26e8fe99d5fbc043d0c30327fb3"}
May 28 15:10:25.246595 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:25.246557    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgvhq" event={"ID":"27010090-9a69-4620-a81b-967332feec6b","Type":"ContainerStarted","Data":"616f648f9389f8e26a4ef8b541411eb32217b9baf5cf6f04fbd43a74e8a4faa5"}
May 28 15:10:25.247073 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:25.246790    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bgvhq"
May 28 15:10:25.248037 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:25.247988    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4x7t" event={"ID":"f895dd66-5bc8-4831-a999-fc429510924f","Type":"ContainerStarted","Data":"d19e3f1ece514fd42619c33f7b6b4063eb7262041a13f13c782a64d6aa3bea41"}
May 28 15:10:25.265077 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:25.265039    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-bgvhq" podStartSLOduration=130.049030535 podStartE2EDuration="2m11.265007312s" podCreationTimestamp="2026-05-28 15:08:14 +0000 UTC" firstStartedPulling="2026-05-28 15:10:22.876457615 +0000 UTC m=+162.810130493" lastFinishedPulling="2026-05-28 15:10:24.092434397 +0000 UTC m=+164.026107270" observedRunningTime="2026-05-28 15:10:25.264195645 +0000 UTC m=+165.197868542" watchObservedRunningTime="2026-05-28 15:10:25.265007312 +0000 UTC m=+165.198680206"
May 28 15:10:25.281236 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:25.281193    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r4x7t" podStartSLOduration=129.068084096 podStartE2EDuration="2m11.281180489s" podCreationTimestamp="2026-05-28 15:08:14 +0000 UTC" firstStartedPulling="2026-05-28 15:10:22.888636715 +0000 UTC m=+162.822309589" lastFinishedPulling="2026-05-28 15:10:25.10173311 +0000 UTC m=+165.035405982" observedRunningTime="2026-05-28 15:10:25.280568574 +0000 UTC m=+165.214241468" watchObservedRunningTime="2026-05-28 15:10:25.281180489 +0000 UTC m=+165.214853381"
May 28 15:10:26.411178 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.411139    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"]
May 28 15:10:26.414661 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.414638    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5vz95"]
May 28 15:10:26.414827 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.414809    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.417569 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.417406    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 15:10:26.417569 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.417427    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 15:10:26.417879 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.417860    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.418831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.418542    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 15:10:26.418831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.418555    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 15:10:26.418831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.418629    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 15:10:26.418831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.418559    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 15:10:26.419241 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.419218    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j5h76\""
May 28 15:10:26.420524 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.420309    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 15:10:26.420524 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.420337    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhxdm\""
May 28 15:10:26.420524 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.420371    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 15:10:26.420862 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.420528    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 15:10:26.428822 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.428803    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"]
May 28 15:10:26.556892 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.556863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-textfile\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.556901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xr9\" (UniqueName: \"kubernetes.io/projected/9f53ee4c-c970-4a6f-a722-c2568e8827ef-kube-api-access-h7xr9\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.556928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.557103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.556960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-root\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47fd9f3f-7e53-4212-8670-f4f32922f9bf-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.557103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f53ee4c-c970-4a6f-a722-c2568e8827ef-metrics-client-ca\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-wtmp\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47fd9f3f-7e53-4212-8670-f4f32922f9bf-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8729\" (UniqueName: \"kubernetes.io/projected/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-api-access-f8729\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.557370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-sys\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557695 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-tls\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.557695 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.557416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.658384 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658337    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.658384 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658381    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658426    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-sys\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658448    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-tls\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658471    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658491    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-textfile\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658521    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xr9\" (UniqueName: \"kubernetes.io/projected/9f53ee4c-c970-4a6f-a722-c2568e8827ef-kube-api-access-h7xr9\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:10:26.658533    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658547    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-sys\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658552    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.658626 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:10:26.658603    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-tls podName:47fd9f3f-7e53-4212-8670-f4f32922f9bf nodeName:}" failed. No retries permitted until 2026-05-28 15:10:27.158581279 +0000 UTC m=+167.092254150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-9jlvk" (UID: "47fd9f3f-7e53-4212-8670-f4f32922f9bf") : secret "kube-state-metrics-tls" not found
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-root\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47fd9f3f-7e53-4212-8670-f4f32922f9bf-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-root\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658710    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f53ee4c-c970-4a6f-a722-c2568e8827ef-metrics-client-ca\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658747    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-wtmp\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658773    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47fd9f3f-7e53-4212-8670-f4f32922f9bf-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658800    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658825    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8729\" (UniqueName: \"kubernetes.io/projected/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-api-access-f8729\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.659100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658899    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-wtmp\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659573 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.658992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47fd9f3f-7e53-4212-8670-f4f32922f9bf-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.659624 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.659262    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-textfile\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659624 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.659346    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.659624 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.659572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47fd9f3f-7e53-4212-8670-f4f32922f9bf-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.659829 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.659796    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f53ee4c-c970-4a6f-a722-c2568e8827ef-metrics-client-ca\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.659887 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.659822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.661864 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.661714    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.662003 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.661888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.662003 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.661992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f53ee4c-c970-4a6f-a722-c2568e8827ef-node-exporter-tls\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.667402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.667370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8729\" (UniqueName: \"kubernetes.io/projected/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-api-access-f8729\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:26.667677 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.667658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xr9\" (UniqueName: \"kubernetes.io/projected/9f53ee4c-c970-4a6f-a722-c2568e8827ef-kube-api-access-h7xr9\") pod \"node-exporter-5vz95\" (UID: \"9f53ee4c-c970-4a6f-a722-c2568e8827ef\") " pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.735389 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:26.735361    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5vz95"
May 28 15:10:26.744939 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:26.744902    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f53ee4c_c970_4a6f_a722_c2568e8827ef.slice/crio-7471c804c583e89616ea6d707cbc7baebaaf4369e4f3fc26cbdae922157b943d WatchSource:0}: Error finding container 7471c804c583e89616ea6d707cbc7baebaaf4369e4f3fc26cbdae922157b943d: Status 404 returned error can't find the container with id 7471c804c583e89616ea6d707cbc7baebaaf4369e4f3fc26cbdae922157b943d
May 28 15:10:27.164103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.164061    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:27.166938 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.166914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47fd9f3f-7e53-4212-8670-f4f32922f9bf-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9jlvk\" (UID: \"47fd9f3f-7e53-4212-8670-f4f32922f9bf\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:27.255066 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.255002    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5vz95" event={"ID":"9f53ee4c-c970-4a6f-a722-c2568e8827ef","Type":"ContainerStarted","Data":"7471c804c583e89616ea6d707cbc7baebaaf4369e4f3fc26cbdae922157b943d"}
May 28 15:10:27.327355 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.327326    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"
May 28 15:10:27.443878 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.443800    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 15:10:27.448948 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.448924    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.451620 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.451530    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gq8gp\""
May 28 15:10:27.451768 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.451642    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 15:10:27.451768 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.451756    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 15:10:27.452005 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.451891    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 15:10:27.452005 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.451895    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 15:10:27.452201 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.452187    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 15:10:27.452406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.452383    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 15:10:27.452520 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.452384    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 15:10:27.452884 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.452863    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 15:10:27.452983 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.452955    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 15:10:27.462769 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.462740    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 15:10:27.467541 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.467483    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk"]
May 28 15:10:27.471748 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:27.471721    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47fd9f3f_7e53_4212_8670_f4f32922f9bf.slice/crio-c1a0b8c28f850fd6a85bf92b50ef584726b200d301b364672e2e727a341fdea5 WatchSource:0}: Error finding container c1a0b8c28f850fd6a85bf92b50ef584726b200d301b364672e2e727a341fdea5: Status 404 returned error can't find the container with id c1a0b8c28f850fd6a85bf92b50ef584726b200d301b364672e2e727a341fdea5
May 28 15:10:27.567964 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.567924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568146 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.567971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6shlv\" (UniqueName: \"kubernetes.io/projected/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-kube-api-access-6shlv\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568146 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568146 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568146 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-config-out\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568344 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568344 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568344 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568344 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568526 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-web-config\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568526 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568526 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.568526 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.568482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669452 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669417    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669636 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669465    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669636 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:10:27.669600    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-trusted-ca-bundle podName:6e90e93c-3787-4fbd-af92-8e4d74c4ad6a nodeName:}" failed. No retries permitted until 2026-05-28 15:10:28.169577835 +0000 UTC m=+168.103250727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "6e90e93c-3787-4fbd-af92-8e4d74c4ad6a") : configmap references non-existent config key: ca-bundle.crt
May 28 15:10:27.669636 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669623    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-config-out\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669651    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669693    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669720    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669758    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.669814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669792    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-web-config\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.670011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669812    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.670011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669857    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.670011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.670011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669931    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.670011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669968    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.670011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.669997    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6shlv\" (UniqueName: \"kubernetes.io/projected/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-kube-api-access-6shlv\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.671885 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.671855    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.672894 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.672861    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-config-out\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.673004 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.672984    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.673536 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.673507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-web-config\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.674462 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.674376    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.674462 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.674441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.674630 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.674609    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.675200 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.675179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.675298 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.675277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.676284 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.676261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:27.685609 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:27.685568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6shlv\" (UniqueName: \"kubernetes.io/projected/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-kube-api-access-6shlv\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:28.174303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.174268    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:28.174986 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.174966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e90e93c-3787-4fbd-af92-8e4d74c4ad6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:28.260534 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.260501    2562 generic.go:358] "Generic (PLEG): container finished" podID="9f53ee4c-c970-4a6f-a722-c2568e8827ef" containerID="11278080d01e3e477fd024e05e33ef30b5d93ae15eddd4ecddd90005b5802fff" exitCode=0
May 28 15:10:28.260721 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.260587    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5vz95" event={"ID":"9f53ee4c-c970-4a6f-a722-c2568e8827ef","Type":"ContainerDied","Data":"11278080d01e3e477fd024e05e33ef30b5d93ae15eddd4ecddd90005b5802fff"}
May 28 15:10:28.261725 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.261698    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk" event={"ID":"47fd9f3f-7e53-4212-8670-f4f32922f9bf","Type":"ContainerStarted","Data":"c1a0b8c28f850fd6a85bf92b50ef584726b200d301b364672e2e727a341fdea5"}
May 28 15:10:28.360519 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.360493    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 15:10:28.499548 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:28.499518    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 15:10:28.502822 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:28.502787    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e90e93c_3787_4fbd_af92_8e4d74c4ad6a.slice/crio-144dd8883d6a7b44482623aa21ed9cc95cad43d58b535914b8b8586dd43a01ef WatchSource:0}: Error finding container 144dd8883d6a7b44482623aa21ed9cc95cad43d58b535914b8b8586dd43a01ef: Status 404 returned error can't find the container with id 144dd8883d6a7b44482623aa21ed9cc95cad43d58b535914b8b8586dd43a01ef
May 28 15:10:29.270894 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.269491    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5vz95" event={"ID":"9f53ee4c-c970-4a6f-a722-c2568e8827ef","Type":"ContainerStarted","Data":"647286eb295ee77108da3f0ccf0c33536cf35bcef849636ec38f7bdfddf0a93d"}
May 28 15:10:29.270894 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.269535    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5vz95" event={"ID":"9f53ee4c-c970-4a6f-a722-c2568e8827ef","Type":"ContainerStarted","Data":"d370479190f5970f09fb71873379fba7863c572f1bd1a84a342b9cb4facf2a6e"}
May 28 15:10:29.276831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.274237    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk" event={"ID":"47fd9f3f-7e53-4212-8670-f4f32922f9bf","Type":"ContainerStarted","Data":"7edd07ee198315cde4bad090e3683b515c44be36a78aa90bdac55555a5a96213"}
May 28 15:10:29.276831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.274278    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk" event={"ID":"47fd9f3f-7e53-4212-8670-f4f32922f9bf","Type":"ContainerStarted","Data":"d31060549b26c3e05b91c2f1b4ccc5caf5d7e17b8bbbff169b296fd9bf03d6eb"}
May 28 15:10:29.276831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.274292    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk" event={"ID":"47fd9f3f-7e53-4212-8670-f4f32922f9bf","Type":"ContainerStarted","Data":"915d0f13322d11627dd7c590b2e3959a9e6beaff6d5b29eb6e411877e2698a5c"}
May 28 15:10:29.276831 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.276519    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"144dd8883d6a7b44482623aa21ed9cc95cad43d58b535914b8b8586dd43a01ef"}
May 28 15:10:29.292183 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.292129    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5vz95" podStartSLOduration=2.2778765180000002 podStartE2EDuration="3.292112289s" podCreationTimestamp="2026-05-28 15:10:26 +0000 UTC" firstStartedPulling="2026-05-28 15:10:26.746859527 +0000 UTC m=+166.680532401" lastFinishedPulling="2026-05-28 15:10:27.761095302 +0000 UTC m=+167.694768172" observedRunningTime="2026-05-28 15:10:29.290612316 +0000 UTC m=+169.224285212" watchObservedRunningTime="2026-05-28 15:10:29.292112289 +0000 UTC m=+169.225785183"
May 28 15:10:29.310982 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:29.310848    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9jlvk" podStartSLOduration=1.91244334 podStartE2EDuration="3.310830657s" podCreationTimestamp="2026-05-28 15:10:26 +0000 UTC" firstStartedPulling="2026-05-28 15:10:27.473857944 +0000 UTC m=+167.407530815" lastFinishedPulling="2026-05-28 15:10:28.87224526 +0000 UTC m=+168.805918132" observedRunningTime="2026-05-28 15:10:29.309762886 +0000 UTC m=+169.243435780" watchObservedRunningTime="2026-05-28 15:10:29.310830657 +0000 UTC m=+169.244503553"
May 28 15:10:30.280504 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:30.280461    2562 generic.go:358] "Generic (PLEG): container finished" podID="6e90e93c-3787-4fbd-af92-8e4d74c4ad6a" containerID="5492dd91d7c8160a1078db4c9005b434da9510a2f8f356524eabb1432096db30" exitCode=0
May 28 15:10:30.280871 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:30.280528    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerDied","Data":"5492dd91d7c8160a1078db4c9005b434da9510a2f8f356524eabb1432096db30"}
May 28 15:10:32.251082 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.251051    2562 patch_prober.go:28] interesting pod/image-registry-778f78ff99-pz5z2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 15:10:32.251414 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.251107    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:10:32.288407 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.288374    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"b5d22b414b544e940a6d496b13e38a33898648760aaf38a51c849b0bbf805670"}
May 28 15:10:32.288407 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.288407    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"233a4f18a81cadf35f260782d2e79ce0e5f615e2c817c8cc6a9cb768274eebd4"}
May 28 15:10:32.288531 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.288417    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"1863b66c854c9c56c0458f9582484c5ea69575a88c15cdc4bd46b5f638381f7a"}
May 28 15:10:32.288531 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.288428    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"c2a969f22548758b7a43309a96194321b3f1524957b64bccd66c00b5827fbbd3"}
May 28 15:10:32.288531 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.288441    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"782fd7d856fc192574fc94b40f637869c98a6e1e2445feefb9d1a43a548de53d"}
May 28 15:10:32.593279 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.593209    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 15:10:32.597537 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.597514    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.601231 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601208    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 15:10:32.601344 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601260    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 15:10:32.601688 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601667    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 15:10:32.601849 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601702    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 15:10:32.601849 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601713    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 15:10:32.601951 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601882    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 15:10:32.601951 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601667    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 15:10:32.602009 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.601957    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 15:10:32.602368 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.602325    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hb6g4\""
May 28 15:10:32.602578 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.602562    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 15:10:32.602650 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.602635    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bpl3gr881255j\""
May 28 15:10:32.603001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.602848    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 15:10:32.603001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.602871    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 15:10:32.603358 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.603313    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 15:10:32.604190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.604169    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 15:10:32.609719 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.609698    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 15:10:32.619251 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619347 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619347 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619487 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619554 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619667 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/235f9c2d-d801-4d8f-979d-89d39991d79e-config-out\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619731 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619731 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-web-config\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619833 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-config\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619833 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619833 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/235f9c2d-d801-4d8f-979d-89d39991d79e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.619987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.620200 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.619999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xh7q\" (UniqueName: \"kubernetes.io/projected/235f9c2d-d801-4d8f-979d-89d39991d79e-kube-api-access-5xh7q\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.620200 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.620049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.620200 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.620086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721348    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721381    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xh7q\" (UniqueName: \"kubernetes.io/projected/235f9c2d-d801-4d8f-979d-89d39991d79e-kube-api-access-5xh7q\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721592 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721402    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721592 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721430    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721592 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721458    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721748 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721582    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721748 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721622    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721748 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721669    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721887 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721887 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721818    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721893    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/235f9c2d-d801-4d8f-979d-89d39991d79e-config-out\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721919    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.721987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721951    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-web-config\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.721984    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-config\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722048    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722083    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/235f9c2d-d801-4d8f-979d-89d39991d79e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722106    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722142    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722401 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722166    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722800 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722773    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.722934 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.722910    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.723440 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.723127    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.724267 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.724195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.725573 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.725334    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.725770 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.725747    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/235f9c2d-d801-4d8f-979d-89d39991d79e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.726260 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.726235    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.726537 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.726424    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.727399 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.726920    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.727399 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.727208    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-web-config\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.728007 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.727979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/235f9c2d-d801-4d8f-979d-89d39991d79e-config-out\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.728659 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.728610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.728863 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.728836    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-config\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.729148 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.729123    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.729272 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.729243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235f9c2d-d801-4d8f-979d-89d39991d79e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.729592 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.729570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/235f9c2d-d801-4d8f-979d-89d39991d79e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.730337 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.730314    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xh7q\" (UniqueName: \"kubernetes.io/projected/235f9c2d-d801-4d8f-979d-89d39991d79e-kube-api-access-5xh7q\") pod \"prometheus-k8s-0\" (UID: \"235f9c2d-d801-4d8f-979d-89d39991d79e\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:32.909829 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:32.909798    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:33.042704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.042669    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 15:10:33.046704 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:10:33.046672    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235f9c2d_d801_4d8f_979d_89d39991d79e.slice/crio-012966afdbc381ed1cfc95433a3c92626ea681df679b435973a17d198436bce5 WatchSource:0}: Error finding container 012966afdbc381ed1cfc95433a3c92626ea681df679b435973a17d198436bce5: Status 404 returned error can't find the container with id 012966afdbc381ed1cfc95433a3c92626ea681df679b435973a17d198436bce5
May 28 15:10:33.292975 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.292943    2562 generic.go:358] "Generic (PLEG): container finished" podID="235f9c2d-d801-4d8f-979d-89d39991d79e" containerID="165e4643752b0372ce78ecb188044acffcb2dd4f9a7db89402b6bcfe90404c67" exitCode=0
May 28 15:10:33.293380 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.293043    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerDied","Data":"165e4643752b0372ce78ecb188044acffcb2dd4f9a7db89402b6bcfe90404c67"}
May 28 15:10:33.293380 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.293085    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"012966afdbc381ed1cfc95433a3c92626ea681df679b435973a17d198436bce5"}
May 28 15:10:33.296121 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.296096    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e90e93c-3787-4fbd-af92-8e4d74c4ad6a","Type":"ContainerStarted","Data":"51c8c29067e4fd0bcaa84b26cc2aaa80797b50b1adb18744956bdc514382eb21"}
May 28 15:10:33.342479 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.342437    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.039471206 podStartE2EDuration="6.342424678s" podCreationTimestamp="2026-05-28 15:10:27 +0000 UTC" firstStartedPulling="2026-05-28 15:10:28.505106993 +0000 UTC m=+168.438779863" lastFinishedPulling="2026-05-28 15:10:32.808060464 +0000 UTC m=+172.741733335" observedRunningTime="2026-05-28 15:10:33.341132126 +0000 UTC m=+173.274805018" watchObservedRunningTime="2026-05-28 15:10:33.342424678 +0000 UTC m=+173.276097571"
May 28 15:10:33.693099 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:33.693075    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:10:34.193803 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:34.193769    2562 patch_prober.go:28] interesting pod/image-registry-778f78ff99-pz5z2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 15:10:34.194055 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:34.193999    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:10:35.254095 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:35.254065    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bgvhq"
May 28 15:10:36.313180 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:36.313102    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"043ce4be0b2e3f118c1ca8aaf5e3436019e5aea9d4e04835125d27e4a36d4c11"}
May 28 15:10:36.313180 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:36.313140    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"b7e12e120b50f14624a4021b800c2aa213f214bfcaaf55502d000a6a8e4d9992"}
May 28 15:10:38.322602 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:38.322566    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"d1332cfd057488ac85f2fb326da85b7a3146132c2729778dfa0368af8592093c"}
May 28 15:10:38.322602 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:38.322605    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"94cd647c495d8f473f795e27ba47a420c3b080512b236ffb31213f3da6d2637c"}
May 28 15:10:38.323055 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:38.322616    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"f04f8ad9e541c335649d16d2ea2d54be1fc25aee10e738cd3b47fca15a6162e9"}
May 28 15:10:38.323055 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:38.322624    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"235f9c2d-d801-4d8f-979d-89d39991d79e","Type":"ContainerStarted","Data":"34807ef4d4d9c71e685188bf3a9fc1ec9e91b202da265628aa35d8054a0d3fbe"}
May 28 15:10:38.348647 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:38.348603    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.050035151 podStartE2EDuration="6.348589366s" podCreationTimestamp="2026-05-28 15:10:32 +0000 UTC" firstStartedPulling="2026-05-28 15:10:33.294307139 +0000 UTC m=+173.227980019" lastFinishedPulling="2026-05-28 15:10:37.592861347 +0000 UTC m=+177.526534234" observedRunningTime="2026-05-28 15:10:38.345980391 +0000 UTC m=+178.279653285" watchObservedRunningTime="2026-05-28 15:10:38.348589366 +0000 UTC m=+178.282262258"
May 28 15:10:42.250519 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.250484    2562 patch_prober.go:28] interesting pod/image-registry-778f78ff99-pz5z2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 15:10:42.250957 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.250549    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:10:42.250957 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.250597    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:42.251228 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.251169    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"8cbc8f7eed9b314442c17700e0ada59535fb9efcc3811eefdbce8026eab722bb"} pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" containerMessage="Container registry failed liveness probe, will be restarted"
May 28 15:10:42.255914 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.255888    2562 patch_prober.go:28] interesting pod/image-registry-778f78ff99-pz5z2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 15:10:42.256039 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.255932    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:10:42.910572 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:42.910542    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:10:49.356380 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:49.356341    2562 generic.go:358] "Generic (PLEG): container finished" podID="fa9293a7-d63f-415d-8a43-a82e1053bcb5" containerID="fa1fc3eb4bc31f5b61d446f472ee1105de786fd2a77f2e72cdf6cf1b7d3cd847" exitCode=0
May 28 15:10:49.356785 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:49.356391    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7" event={"ID":"fa9293a7-d63f-415d-8a43-a82e1053bcb5","Type":"ContainerDied","Data":"fa1fc3eb4bc31f5b61d446f472ee1105de786fd2a77f2e72cdf6cf1b7d3cd847"}
May 28 15:10:49.356855 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:49.356804    2562 scope.go:117] "RemoveContainer" containerID="fa1fc3eb4bc31f5b61d446f472ee1105de786fd2a77f2e72cdf6cf1b7d3cd847"
May 28 15:10:49.926876 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:49.926842    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgvhq_27010090-9a69-4620-a81b-967332feec6b/dns/0.log"
May 28 15:10:49.932952 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:49.932920    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgvhq_27010090-9a69-4620-a81b-967332feec6b/kube-rbac-proxy/0.log"
May 28 15:10:50.313811 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:50.313739    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v79m4_a4648f74-0eab-4362-b95c-f41f3ac3253e/dns-node-resolver/0.log"
May 28 15:10:50.360730 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:50.360697    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-8rhk7" event={"ID":"fa9293a7-d63f-415d-8a43-a82e1053bcb5","Type":"ContainerStarted","Data":"b4144ead554a532190552b803108bb54facc35ad1b8af5d9f94c0baa66fdfee1"}
May 28 15:10:52.255992 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:52.255964    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:10:54.372212 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:54.372181    2562 generic.go:358] "Generic (PLEG): container finished" podID="1a34797c-99b8-4bfb-bd86-40c00ef98207" containerID="8f149be1d0dfdd189714c053b1cbc23ba17f3f71276be550d99fa40fb2a22055" exitCode=0
May 28 15:10:54.372568 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:54.372224    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr" event={"ID":"1a34797c-99b8-4bfb-bd86-40c00ef98207","Type":"ContainerDied","Data":"8f149be1d0dfdd189714c053b1cbc23ba17f3f71276be550d99fa40fb2a22055"}
May 28 15:10:54.372568 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:54.372475    2562 scope.go:117] "RemoveContainer" containerID="8f149be1d0dfdd189714c053b1cbc23ba17f3f71276be550d99fa40fb2a22055"
May 28 15:10:55.377205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:10:55.377166    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-v8wpr" event={"ID":"1a34797c-99b8-4bfb-bd86-40c00ef98207","Type":"ContainerStarted","Data":"83a942d9b1314a81e54ac1e3a3352ea504eaf79b47d8d126789320fcb7f90929"}
May 28 15:11:07.270076 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:07.270015    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" podUID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerName="registry" containerID="cri-o://8cbc8f7eed9b314442c17700e0ada59535fb9efcc3811eefdbce8026eab722bb" gracePeriod=30
May 28 15:11:08.424354 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:08.424327    2562 generic.go:358] "Generic (PLEG): container finished" podID="0faba5ee-7420-4db7-8ead-74cacb660bad" containerID="8cbc8f7eed9b314442c17700e0ada59535fb9efcc3811eefdbce8026eab722bb" exitCode=0
May 28 15:11:08.424644 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:08.424407    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" event={"ID":"0faba5ee-7420-4db7-8ead-74cacb660bad","Type":"ContainerDied","Data":"8cbc8f7eed9b314442c17700e0ada59535fb9efcc3811eefdbce8026eab722bb"}
May 28 15:11:09.428490 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:09.428456    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2" event={"ID":"0faba5ee-7420-4db7-8ead-74cacb660bad","Type":"ContainerStarted","Data":"8b0e01c63b999af855c85b120433da24c1748617cef14622ad7df44c5ac49a60"}
May 28 15:11:09.428854 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:09.428679    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:11:30.435953 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:30.435927    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-778f78ff99-pz5z2"
May 28 15:11:32.910793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:32.910762    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:11:32.931682 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:32.931660    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:11:33.517144 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:33.517117    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 15:11:51.411445 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:51.411411    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:11:51.413670 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:51.413650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523e2e5d-3908-45f1-bdad-676bee5d9082-metrics-certs\") pod \"network-metrics-daemon-nvz75\" (UID: \"523e2e5d-3908-45f1-bdad-676bee5d9082\") " pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:11:51.695823 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:51.695760    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wjkp\""
May 28 15:11:51.703603 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:51.703586    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvz75"
May 28 15:11:51.824838 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:51.824807    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvz75"]
May 28 15:11:51.831863 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:11:51.831839    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523e2e5d_3908_45f1_bdad_676bee5d9082.slice/crio-fec3f053e9b043c4a07b07cf2c083b4bd007e6cfacd0fd59366dd7fe32b086bc WatchSource:0}: Error finding container fec3f053e9b043c4a07b07cf2c083b4bd007e6cfacd0fd59366dd7fe32b086bc: Status 404 returned error can't find the container with id fec3f053e9b043c4a07b07cf2c083b4bd007e6cfacd0fd59366dd7fe32b086bc
May 28 15:11:52.554772 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:52.554734    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvz75" event={"ID":"523e2e5d-3908-45f1-bdad-676bee5d9082","Type":"ContainerStarted","Data":"fec3f053e9b043c4a07b07cf2c083b4bd007e6cfacd0fd59366dd7fe32b086bc"}
May 28 15:11:53.559269 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:53.559232    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvz75" event={"ID":"523e2e5d-3908-45f1-bdad-676bee5d9082","Type":"ContainerStarted","Data":"e6d9a8b9b0de31c7255077cc8fef7e0c5ca848f9572bcca32d313362c9e17436"}
May 28 15:11:53.559269 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:53.559271    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvz75" event={"ID":"523e2e5d-3908-45f1-bdad-676bee5d9082","Type":"ContainerStarted","Data":"5abe80cdea123e3be940759f1fd99e21bab82e8b02c3e2b47a5ba06146e4cb7e"}
May 28 15:11:53.575266 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:11:53.575223    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nvz75" podStartSLOduration=252.470267747 podStartE2EDuration="4m13.57520783s" podCreationTimestamp="2026-05-28 15:07:40 +0000 UTC" firstStartedPulling="2026-05-28 15:11:51.834108806 +0000 UTC m=+251.767781678" lastFinishedPulling="2026-05-28 15:11:52.939048887 +0000 UTC m=+252.872721761" observedRunningTime="2026-05-28 15:11:53.573458814 +0000 UTC m=+253.507131707" watchObservedRunningTime="2026-05-28 15:11:53.57520783 +0000 UTC m=+253.508880722"
May 28 15:12:40.595808 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:12:40.595772    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:12:40.598690 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:12:40.598665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:12:40.602396 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:12:40.602373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:12:40.604871 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:12:40.604850    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:12:40.606081 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:12:40.606064    2562 kubelet.go:1628] "Image garbage collection succeeded"
May 28 15:14:18.504822 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.504784    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"]
May 28 15:14:18.508990 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.508966    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.513918 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.513895    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mqt6c\""
May 28 15:14:18.514118 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.513915    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 15:14:18.514218 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.513915    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 15:14:18.514218 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.513943    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 15:14:18.515074 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.515055    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 15:14:18.515165 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.515129    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 15:14:18.518978 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.518958    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"]
May 28 15:14:18.657040 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.656994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-cert\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.657173 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.657050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-metrics-cert\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.657173 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.657073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqw6b\" (UniqueName: \"kubernetes.io/projected/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-kube-api-access-fqw6b\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.657173 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.657124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-manager-config\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.757633 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.757567    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-manager-config\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.757633 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.757630    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-cert\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.757814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.757658    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-metrics-cert\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.757814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.757689    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqw6b\" (UniqueName: \"kubernetes.io/projected/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-kube-api-access-fqw6b\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.758276 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.758254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-manager-config\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.760422 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.760399    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-metrics-cert\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.760530 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.760419    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-cert\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.766538 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.766500    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqw6b\" (UniqueName: \"kubernetes.io/projected/73550f84-60ea-4bbe-8aa2-08e20cbbadd7-kube-api-access-fqw6b\") pod \"lws-controller-manager-5657b98b9f-jhnp8\" (UID: \"73550f84-60ea-4bbe-8aa2-08e20cbbadd7\") " pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.823907 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.823884    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:18.955256 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.955093    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"]
May 28 15:14:18.957867 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:14:18.957831    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73550f84_60ea_4bbe_8aa2_08e20cbbadd7.slice/crio-eb469cc7f30d3a4ee0832c5c56b77fc41864d820761d555042828c5b395d5777 WatchSource:0}: Error finding container eb469cc7f30d3a4ee0832c5c56b77fc41864d820761d555042828c5b395d5777: Status 404 returned error can't find the container with id eb469cc7f30d3a4ee0832c5c56b77fc41864d820761d555042828c5b395d5777
May 28 15:14:18.959779 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:18.959760    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:14:19.960467 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:19.960423    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8" event={"ID":"73550f84-60ea-4bbe-8aa2-08e20cbbadd7","Type":"ContainerStarted","Data":"eb469cc7f30d3a4ee0832c5c56b77fc41864d820761d555042828c5b395d5777"}
May 28 15:14:21.838308 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.838277    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"]
May 28 15:14:21.841713 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.841693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:21.844150 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.844128    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 15:14:21.844253 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.844194    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c8lf9\""
May 28 15:14:21.844253 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.844128    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 15:14:21.844379 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.844278    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 15:14:21.844420 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.844378    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 15:14:21.863100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.863073    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"]
May 28 15:14:21.970861 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.970798    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8" event={"ID":"73550f84-60ea-4bbe-8aa2-08e20cbbadd7","Type":"ContainerStarted","Data":"a18885b63b505c3633344a2adca37b009fdb933e1555ddf4a479ddb0dc2db31c"}
May 28 15:14:21.970975 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.970898    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:21.983423 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.983398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e720eece-5426-46e2-a014-141b3faddb96-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:21.983510 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.983437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtn2k\" (UniqueName: \"kubernetes.io/projected/e720eece-5426-46e2-a014-141b3faddb96-kube-api-access-vtn2k\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:21.983510 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.983493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e720eece-5426-46e2-a014-141b3faddb96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:21.996624 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:21.996583    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8" podStartSLOduration=1.323153388 podStartE2EDuration="3.996572059s" podCreationTimestamp="2026-05-28 15:14:18 +0000 UTC" firstStartedPulling="2026-05-28 15:14:18.959897005 +0000 UTC m=+398.893569876" lastFinishedPulling="2026-05-28 15:14:21.633315676 +0000 UTC m=+401.566988547" observedRunningTime="2026-05-28 15:14:21.995850844 +0000 UTC m=+401.929523737" watchObservedRunningTime="2026-05-28 15:14:21.996572059 +0000 UTC m=+401.930244952"
May 28 15:14:22.084753 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.084726    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e720eece-5426-46e2-a014-141b3faddb96-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.084828 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.084783    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtn2k\" (UniqueName: \"kubernetes.io/projected/e720eece-5426-46e2-a014-141b3faddb96-kube-api-access-vtn2k\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.085014 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.084996    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e720eece-5426-46e2-a014-141b3faddb96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.087399 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.087376    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e720eece-5426-46e2-a014-141b3faddb96-webhook-cert\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.087486 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.087440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e720eece-5426-46e2-a014-141b3faddb96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.099725 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.095623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtn2k\" (UniqueName: \"kubernetes.io/projected/e720eece-5426-46e2-a014-141b3faddb96-kube-api-access-vtn2k\") pod \"opendatahub-operator-controller-manager-57c44ff6d8-rthmb\" (UID: \"e720eece-5426-46e2-a014-141b3faddb96\") " pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.152267 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.152246    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:22.296883 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.296844    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"]
May 28 15:14:22.299212 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:14:22.299179    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode720eece_5426_46e2_a014_141b3faddb96.slice/crio-e367a1ac2a67496ed30b8770031faa9086c9c57643d2b28399fe077e831984f2 WatchSource:0}: Error finding container e367a1ac2a67496ed30b8770031faa9086c9c57643d2b28399fe077e831984f2: Status 404 returned error can't find the container with id e367a1ac2a67496ed30b8770031faa9086c9c57643d2b28399fe077e831984f2
May 28 15:14:22.975505 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:22.975462    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb" event={"ID":"e720eece-5426-46e2-a014-141b3faddb96","Type":"ContainerStarted","Data":"e367a1ac2a67496ed30b8770031faa9086c9c57643d2b28399fe077e831984f2"}
May 28 15:14:24.983379 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:24.983327    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb" event={"ID":"e720eece-5426-46e2-a014-141b3faddb96","Type":"ContainerStarted","Data":"6611aed00f369cfa9d6bc925095e616995452f5a656eb187771613f94daf3770"}
May 28 15:14:24.983719 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:24.983416    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:25.009303 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:25.009256    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb" podStartSLOduration=1.504764551 podStartE2EDuration="4.009243684s" podCreationTimestamp="2026-05-28 15:14:21 +0000 UTC" firstStartedPulling="2026-05-28 15:14:22.30092228 +0000 UTC m=+402.234595151" lastFinishedPulling="2026-05-28 15:14:24.805401399 +0000 UTC m=+404.739074284" observedRunningTime="2026-05-28 15:14:25.007454344 +0000 UTC m=+404.941127237" watchObservedRunningTime="2026-05-28 15:14:25.009243684 +0000 UTC m=+404.942916576"
May 28 15:14:32.978108 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:32.978077    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5657b98b9f-jhnp8"
May 28 15:14:35.989059 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:35.989005    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57c44ff6d8-rthmb"
May 28 15:14:42.753244 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.753211    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"]
May 28 15:14:42.759887 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.759864    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.762640 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.762616    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 15:14:42.762780 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.762671    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 15:14:42.764001 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.763983    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zk9v5\""
May 28 15:14:42.764131 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.764000    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 15:14:42.764131 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.764039    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 15:14:42.767860 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.767840    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"]
May 28 15:14:42.832366 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.832338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-tls-certs\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.832460 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.832371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6q6t\" (UniqueName: \"kubernetes.io/projected/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-kube-api-access-p6q6t\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.832501 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.832458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-tmp\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.932806 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.932785    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-tmp\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.932906 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.932821    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-tls-certs\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.932906 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.932843    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6q6t\" (UniqueName: \"kubernetes.io/projected/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-kube-api-access-p6q6t\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.935058 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.935038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-tmp\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.935274 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.935258    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-tls-certs\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:42.940378 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:42.940355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6q6t\" (UniqueName: \"kubernetes.io/projected/13cc3b05-f9ea-4f48-8331-f7bebc114c7a-kube-api-access-p6q6t\") pod \"kube-auth-proxy-79b6697f59-jpjl2\" (UID: \"13cc3b05-f9ea-4f48-8331-f7bebc114c7a\") " pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:43.070090 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:43.070012    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"
May 28 15:14:43.193691 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:43.193627    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2"]
May 28 15:14:43.196355 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:14:43.196326    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cc3b05_f9ea_4f48_8331_f7bebc114c7a.slice/crio-a3ae3c5129a35739fba476987e6709749988b07ce2108da4e409cf36990e5c6d WatchSource:0}: Error finding container a3ae3c5129a35739fba476987e6709749988b07ce2108da4e409cf36990e5c6d: Status 404 returned error can't find the container with id a3ae3c5129a35739fba476987e6709749988b07ce2108da4e409cf36990e5c6d
May 28 15:14:44.043908 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:44.043865    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2" event={"ID":"13cc3b05-f9ea-4f48-8331-f7bebc114c7a","Type":"ContainerStarted","Data":"a3ae3c5129a35739fba476987e6709749988b07ce2108da4e409cf36990e5c6d"}
May 28 15:14:47.055937 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:47.055896    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2" event={"ID":"13cc3b05-f9ea-4f48-8331-f7bebc114c7a","Type":"ContainerStarted","Data":"be3f1116f8602f2aa5350fc287c94991a448e729d02c99d3536f75559a93b9b9"}
May 28 15:14:47.081786 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:14:47.081712    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79b6697f59-jpjl2" podStartSLOduration=1.3848728989999999 podStartE2EDuration="5.081694524s" podCreationTimestamp="2026-05-28 15:14:42 +0000 UTC" firstStartedPulling="2026-05-28 15:14:43.198357925 +0000 UTC m=+423.132030798" lastFinishedPulling="2026-05-28 15:14:46.895179549 +0000 UTC m=+426.828852423" observedRunningTime="2026-05-28 15:14:47.080234391 +0000 UTC m=+427.013907287" watchObservedRunningTime="2026-05-28 15:14:47.081694524 +0000 UTC m=+427.015367418"
May 28 15:17:31.033432 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.033382    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:31.036765 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.036743    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.039239 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.039219    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 15:17:31.039239 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.039232    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 15:17:31.039421 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.039303    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jxjrw\""
May 28 15:17:31.040199 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.040169    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 15:17:31.042816 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.042795    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:31.095336 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.095311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7cc\" (UniqueName: \"kubernetes.io/projected/10f95009-35ad-43b0-83d3-278c7a76d812-kube-api-access-qq7cc\") pod \"limitador-limitador-7d549b5b-68hqg\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") " pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.095425 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.095338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f95009-35ad-43b0-83d3-278c7a76d812-config-file\") pod \"limitador-limitador-7d549b5b-68hqg\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") " pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.137103 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.137080    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:31.196500 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.196479    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7cc\" (UniqueName: \"kubernetes.io/projected/10f95009-35ad-43b0-83d3-278c7a76d812-kube-api-access-qq7cc\") pod \"limitador-limitador-7d549b5b-68hqg\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") " pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.196638 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.196512    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f95009-35ad-43b0-83d3-278c7a76d812-config-file\") pod \"limitador-limitador-7d549b5b-68hqg\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") " pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.197194 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.197177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f95009-35ad-43b0-83d3-278c7a76d812-config-file\") pod \"limitador-limitador-7d549b5b-68hqg\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") " pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.204190 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.204166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7cc\" (UniqueName: \"kubernetes.io/projected/10f95009-35ad-43b0-83d3-278c7a76d812-kube-api-access-qq7cc\") pod \"limitador-limitador-7d549b5b-68hqg\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") " pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.347215 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.347161    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:31.469652 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.469626    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:31.472382 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:17:31.472353    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f95009_35ad_43b0_83d3_278c7a76d812.slice/crio-e2ffb59d8e7bb45dfe7b2c6fbc0633d5c95cf0fc7ffb972464bb482a1e49f90d WatchSource:0}: Error finding container e2ffb59d8e7bb45dfe7b2c6fbc0633d5c95cf0fc7ffb972464bb482a1e49f90d: Status 404 returned error can't find the container with id e2ffb59d8e7bb45dfe7b2c6fbc0633d5c95cf0fc7ffb972464bb482a1e49f90d
May 28 15:17:31.574507 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.574478    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg" event={"ID":"10f95009-35ad-43b0-83d3-278c7a76d812","Type":"ContainerStarted","Data":"e2ffb59d8e7bb45dfe7b2c6fbc0633d5c95cf0fc7ffb972464bb482a1e49f90d"}
May 28 15:17:31.847669 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.847642    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vppmz"]
May 28 15:17:31.852440 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.852416    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:31.854696 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.854676    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lm6l6\""
May 28 15:17:31.860760 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.860741    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vppmz"]
May 28 15:17:31.901991 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:31.901965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xrwn\" (UniqueName: \"kubernetes.io/projected/98601e88-81f2-4a67-839d-3dbb4334059a-kube-api-access-5xrwn\") pod \"authorino-f99f4b5cd-vppmz\" (UID: \"98601e88-81f2-4a67-839d-3dbb4334059a\") " pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:32.002280 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:32.002259    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xrwn\" (UniqueName: \"kubernetes.io/projected/98601e88-81f2-4a67-839d-3dbb4334059a-kube-api-access-5xrwn\") pod \"authorino-f99f4b5cd-vppmz\" (UID: \"98601e88-81f2-4a67-839d-3dbb4334059a\") " pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:32.009827 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:32.009809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xrwn\" (UniqueName: \"kubernetes.io/projected/98601e88-81f2-4a67-839d-3dbb4334059a-kube-api-access-5xrwn\") pod \"authorino-f99f4b5cd-vppmz\" (UID: \"98601e88-81f2-4a67-839d-3dbb4334059a\") " pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:32.174424 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:32.174397    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:32.333582 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:32.333526    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vppmz"]
May 28 15:17:32.580062 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:32.579958    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vppmz" event={"ID":"98601e88-81f2-4a67-839d-3dbb4334059a","Type":"ContainerStarted","Data":"54aee43df238ef10efdfc161d2627e39cc2615a19259b5786184ad42793dbac1"}
May 28 15:17:35.593276 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:35.593182    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg" event={"ID":"10f95009-35ad-43b0-83d3-278c7a76d812","Type":"ContainerStarted","Data":"336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8"}
May 28 15:17:35.593276 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:35.593254    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:35.612773 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:35.612721    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg" podStartSLOduration=0.785855075 podStartE2EDuration="4.612706519s" podCreationTimestamp="2026-05-28 15:17:31 +0000 UTC" firstStartedPulling="2026-05-28 15:17:31.474543294 +0000 UTC m=+591.408216169" lastFinishedPulling="2026-05-28 15:17:35.301394737 +0000 UTC m=+595.235067613" observedRunningTime="2026-05-28 15:17:35.610060303 +0000 UTC m=+595.543733190" watchObservedRunningTime="2026-05-28 15:17:35.612706519 +0000 UTC m=+595.546379445"
May 28 15:17:36.598276 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:36.598232    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vppmz" event={"ID":"98601e88-81f2-4a67-839d-3dbb4334059a","Type":"ContainerStarted","Data":"bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576"}
May 28 15:17:36.612695 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:36.612642    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-vppmz" podStartSLOduration=1.463939648 podStartE2EDuration="5.61262752s" podCreationTimestamp="2026-05-28 15:17:31 +0000 UTC" firstStartedPulling="2026-05-28 15:17:32.339856062 +0000 UTC m=+592.273528946" lastFinishedPulling="2026-05-28 15:17:36.488543945 +0000 UTC m=+596.422216818" observedRunningTime="2026-05-28 15:17:36.611571857 +0000 UTC m=+596.545244751" watchObservedRunningTime="2026-05-28 15:17:36.61262752 +0000 UTC m=+596.546300413"
May 28 15:17:36.792173 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:36.792097    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vppmz"]
May 28 15:17:38.610002 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:38.606377    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-vppmz" podUID="98601e88-81f2-4a67-839d-3dbb4334059a" containerName="authorino" containerID="cri-o://bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576" gracePeriod=30
May 28 15:17:38.853473 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:38.853450    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:38.967615 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:38.967536    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xrwn\" (UniqueName: \"kubernetes.io/projected/98601e88-81f2-4a67-839d-3dbb4334059a-kube-api-access-5xrwn\") pod \"98601e88-81f2-4a67-839d-3dbb4334059a\" (UID: \"98601e88-81f2-4a67-839d-3dbb4334059a\") "
May 28 15:17:38.969513 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:38.969488    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98601e88-81f2-4a67-839d-3dbb4334059a-kube-api-access-5xrwn" (OuterVolumeSpecName: "kube-api-access-5xrwn") pod "98601e88-81f2-4a67-839d-3dbb4334059a" (UID: "98601e88-81f2-4a67-839d-3dbb4334059a"). InnerVolumeSpecName "kube-api-access-5xrwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:17:39.068552 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.068515    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xrwn\" (UniqueName: \"kubernetes.io/projected/98601e88-81f2-4a67-839d-3dbb4334059a-kube-api-access-5xrwn\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:17:39.610737 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.610708    2562 generic.go:358] "Generic (PLEG): container finished" podID="98601e88-81f2-4a67-839d-3dbb4334059a" containerID="bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576" exitCode=0
May 28 15:17:39.611127 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.610756    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-vppmz"
May 28 15:17:39.611127 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.610795    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vppmz" event={"ID":"98601e88-81f2-4a67-839d-3dbb4334059a","Type":"ContainerDied","Data":"bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576"}
May 28 15:17:39.611127 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.610837    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-vppmz" event={"ID":"98601e88-81f2-4a67-839d-3dbb4334059a","Type":"ContainerDied","Data":"54aee43df238ef10efdfc161d2627e39cc2615a19259b5786184ad42793dbac1"}
May 28 15:17:39.611127 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.610856    2562 scope.go:117] "RemoveContainer" containerID="bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576"
May 28 15:17:39.619505 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.619483    2562 scope.go:117] "RemoveContainer" containerID="bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576"
May 28 15:17:39.619776 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:17:39.619748    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576\": container with ID starting with bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576 not found: ID does not exist" containerID="bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576"
May 28 15:17:39.619823 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.619785    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576"} err="failed to get container status \"bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576\": rpc error: code = NotFound desc = could not find container \"bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576\": container with ID starting with bb662150071f5d5bfbf5348f4ba9ba07da90e08638bfc218b83a0f9db1272576 not found: ID does not exist"
May 28 15:17:39.629864 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.629839    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vppmz"]
May 28 15:17:39.633100 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:39.633081    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-vppmz"]
May 28 15:17:40.626929 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:40.626904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:17:40.627288 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:40.627167    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:17:40.633052 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:40.633033    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:17:40.633270 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:40.633257    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:17:40.697868 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:40.697840    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98601e88-81f2-4a67-839d-3dbb4334059a" path="/var/lib/kubelet/pods/98601e88-81f2-4a67-839d-3dbb4334059a/volumes"
May 28 15:17:46.599289 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:46.599261    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:47.807928 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:47.807893    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:47.808367 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:47.808109    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg" podUID="10f95009-35ad-43b0-83d3-278c7a76d812" containerName="limitador" containerID="cri-o://336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8" gracePeriod=30
May 28 15:17:48.362912 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.362886    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:48.437724 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.437660    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq7cc\" (UniqueName: \"kubernetes.io/projected/10f95009-35ad-43b0-83d3-278c7a76d812-kube-api-access-qq7cc\") pod \"10f95009-35ad-43b0-83d3-278c7a76d812\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") "
May 28 15:17:48.437724 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.437712    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f95009-35ad-43b0-83d3-278c7a76d812-config-file\") pod \"10f95009-35ad-43b0-83d3-278c7a76d812\" (UID: \"10f95009-35ad-43b0-83d3-278c7a76d812\") "
May 28 15:17:48.438060 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.438039    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10f95009-35ad-43b0-83d3-278c7a76d812-config-file" (OuterVolumeSpecName: "config-file") pod "10f95009-35ad-43b0-83d3-278c7a76d812" (UID: "10f95009-35ad-43b0-83d3-278c7a76d812"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 15:17:48.439749 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.439728    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f95009-35ad-43b0-83d3-278c7a76d812-kube-api-access-qq7cc" (OuterVolumeSpecName: "kube-api-access-qq7cc") pod "10f95009-35ad-43b0-83d3-278c7a76d812" (UID: "10f95009-35ad-43b0-83d3-278c7a76d812"). InnerVolumeSpecName "kube-api-access-qq7cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:17:48.538857 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.538834    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq7cc\" (UniqueName: \"kubernetes.io/projected/10f95009-35ad-43b0-83d3-278c7a76d812-kube-api-access-qq7cc\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:17:48.538857 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.538856    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10f95009-35ad-43b0-83d3-278c7a76d812-config-file\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:17:48.642974 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.642939    2562 generic.go:358] "Generic (PLEG): container finished" podID="10f95009-35ad-43b0-83d3-278c7a76d812" containerID="336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8" exitCode=0
May 28 15:17:48.643130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.642981    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg" event={"ID":"10f95009-35ad-43b0-83d3-278c7a76d812","Type":"ContainerDied","Data":"336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8"}
May 28 15:17:48.643130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.643002    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg" event={"ID":"10f95009-35ad-43b0-83d3-278c7a76d812","Type":"ContainerDied","Data":"e2ffb59d8e7bb45dfe7b2c6fbc0633d5c95cf0fc7ffb972464bb482a1e49f90d"}
May 28 15:17:48.643130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.643015    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-68hqg"
May 28 15:17:48.643130 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.643042    2562 scope.go:117] "RemoveContainer" containerID="336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8"
May 28 15:17:48.651844 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.651821    2562 scope.go:117] "RemoveContainer" containerID="336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8"
May 28 15:17:48.652122 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:17:48.652099    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8\": container with ID starting with 336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8 not found: ID does not exist" containerID="336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8"
May 28 15:17:48.652205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.652128    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8"} err="failed to get container status \"336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8\": rpc error: code = NotFound desc = could not find container \"336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8\": container with ID starting with 336a79fa68b2504f4df353725fd68f5ca12a9926b26d60cf5ba46cf143889bc8 not found: ID does not exist"
May 28 15:17:48.664448 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.664428    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:48.668072 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.668049    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-68hqg"]
May 28 15:17:48.697596 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:48.697550    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f95009-35ad-43b0-83d3-278c7a76d812" path="/var/lib/kubelet/pods/10f95009-35ad-43b0-83d3-278c7a76d812/volumes"
May 28 15:17:53.574157 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574119    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qfqgw"]
May 28 15:17:53.574717 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574597    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f95009-35ad-43b0-83d3-278c7a76d812" containerName="limitador"
May 28 15:17:53.574717 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574616    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f95009-35ad-43b0-83d3-278c7a76d812" containerName="limitador"
May 28 15:17:53.574717 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574627    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98601e88-81f2-4a67-839d-3dbb4334059a" containerName="authorino"
May 28 15:17:53.574717 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574636    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="98601e88-81f2-4a67-839d-3dbb4334059a" containerName="authorino"
May 28 15:17:53.574937 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574731    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="10f95009-35ad-43b0-83d3-278c7a76d812" containerName="limitador"
May 28 15:17:53.574937 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.574748    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="98601e88-81f2-4a67-839d-3dbb4334059a" containerName="authorino"
May 28 15:17:53.577671 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.577650    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.580122 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.580101    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sz7zs\""
May 28 15:17:53.580221 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.580156    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 28 15:17:53.586202 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.586183    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qfqgw"]
May 28 15:17:53.678154 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.678128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f26jx\" (UniqueName: \"kubernetes.io/projected/002989fd-a550-4f1d-b30a-ed981041993c-kube-api-access-f26jx\") pod \"postgres-68c4fbbd6f-qfqgw\" (UID: \"002989fd-a550-4f1d-b30a-ed981041993c\") " pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.678270 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.678220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/002989fd-a550-4f1d-b30a-ed981041993c-data\") pod \"postgres-68c4fbbd6f-qfqgw\" (UID: \"002989fd-a550-4f1d-b30a-ed981041993c\") " pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.779385 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.779318    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/002989fd-a550-4f1d-b30a-ed981041993c-data\") pod \"postgres-68c4fbbd6f-qfqgw\" (UID: \"002989fd-a550-4f1d-b30a-ed981041993c\") " pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.779385 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.779381    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f26jx\" (UniqueName: \"kubernetes.io/projected/002989fd-a550-4f1d-b30a-ed981041993c-kube-api-access-f26jx\") pod \"postgres-68c4fbbd6f-qfqgw\" (UID: \"002989fd-a550-4f1d-b30a-ed981041993c\") " pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.779918 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.779896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/002989fd-a550-4f1d-b30a-ed981041993c-data\") pod \"postgres-68c4fbbd6f-qfqgw\" (UID: \"002989fd-a550-4f1d-b30a-ed981041993c\") " pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.788650 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.788626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f26jx\" (UniqueName: \"kubernetes.io/projected/002989fd-a550-4f1d-b30a-ed981041993c-kube-api-access-f26jx\") pod \"postgres-68c4fbbd6f-qfqgw\" (UID: \"002989fd-a550-4f1d-b30a-ed981041993c\") " pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:53.890918 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:53.890893    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:54.022204 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:54.022173    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qfqgw"]
May 28 15:17:54.026040 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:17:54.025985    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002989fd_a550_4f1d_b30a_ed981041993c.slice/crio-30b96a1ccfe88241f6aceb4098b8d7cfe49299023573f0a7b1fc20c443aba636 WatchSource:0}: Error finding container 30b96a1ccfe88241f6aceb4098b8d7cfe49299023573f0a7b1fc20c443aba636: Status 404 returned error can't find the container with id 30b96a1ccfe88241f6aceb4098b8d7cfe49299023573f0a7b1fc20c443aba636
May 28 15:17:54.662285 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:54.662258    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qfqgw" event={"ID":"002989fd-a550-4f1d-b30a-ed981041993c","Type":"ContainerStarted","Data":"30b96a1ccfe88241f6aceb4098b8d7cfe49299023573f0a7b1fc20c443aba636"}
May 28 15:17:59.681227 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:59.681189    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qfqgw" event={"ID":"002989fd-a550-4f1d-b30a-ed981041993c","Type":"ContainerStarted","Data":"c635fcaec6cd0ec73a123ba73bc4d6971c602d74223cfca970d1a51357d482f5"}
May 28 15:17:59.681595 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:59.681250    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:17:59.696473 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:17:59.696406    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-qfqgw" podStartSLOduration=1.860707488 podStartE2EDuration="6.696387871s" podCreationTimestamp="2026-05-28 15:17:53 +0000 UTC" firstStartedPulling="2026-05-28 15:17:54.027520711 +0000 UTC m=+613.961193582" lastFinishedPulling="2026-05-28 15:17:58.863201082 +0000 UTC m=+618.796873965" observedRunningTime="2026-05-28 15:17:59.695730571 +0000 UTC m=+619.629403476" watchObservedRunningTime="2026-05-28 15:17:59.696387871 +0000 UTC m=+619.630060767"
May 28 15:18:05.712784 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:05.712758    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-qfqgw"
May 28 15:18:06.228400 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.228367    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-49tg2"]
May 28 15:18:06.235127 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.235098    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:06.235578 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.235556    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-49tg2"]
May 28 15:18:06.237536 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.237512    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 15:18:06.238445 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.238425    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lm6l6\""
May 28 15:18:06.238547 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.238443    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 15:18:06.374327 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.374303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9lmm\" (UniqueName: \"kubernetes.io/projected/ff142648-44fc-4845-a321-d55dbcc07fb7-kube-api-access-d9lmm\") pod \"authorino-8b475cf9f-49tg2\" (UID: \"ff142648-44fc-4845-a321-d55dbcc07fb7\") " pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:06.427232 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.427201    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-49tg2"]
May 28 15:18:06.427427 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:18:06.427405    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d9lmm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-49tg2" podUID="ff142648-44fc-4845-a321-d55dbcc07fb7"
May 28 15:18:06.452187 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.452162    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vxfxx"]
May 28 15:18:06.455969 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.455953    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.458494 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.458477    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 15:18:06.463589 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.463569    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vxfxx"]
May 28 15:18:06.475456 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.475432    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9lmm\" (UniqueName: \"kubernetes.io/projected/ff142648-44fc-4845-a321-d55dbcc07fb7-kube-api-access-d9lmm\") pod \"authorino-8b475cf9f-49tg2\" (UID: \"ff142648-44fc-4845-a321-d55dbcc07fb7\") " pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:06.483655 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.483605    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9lmm\" (UniqueName: \"kubernetes.io/projected/ff142648-44fc-4845-a321-d55dbcc07fb7-kube-api-access-d9lmm\") pod \"authorino-8b475cf9f-49tg2\" (UID: \"ff142648-44fc-4845-a321-d55dbcc07fb7\") " pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:06.491812 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.491792    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vxfxx"]
May 28 15:18:06.491961 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:18:06.491945    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xjv6q tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-xjv6q tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-vxfxx" podUID="a8456f03-55c1-4d52-8e57-a5cfcd5d8930"
May 28 15:18:06.576119 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.576093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjv6q\" (UniqueName: \"kubernetes.io/projected/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-kube-api-access-xjv6q\") pod \"authorino-56fdd757f5-vxfxx\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") " pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.576211 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.576126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-tls-cert\") pod \"authorino-56fdd757f5-vxfxx\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") " pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.677387 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.677364    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjv6q\" (UniqueName: \"kubernetes.io/projected/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-kube-api-access-xjv6q\") pod \"authorino-56fdd757f5-vxfxx\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") " pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.677471 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.677393    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-tls-cert\") pod \"authorino-56fdd757f5-vxfxx\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") " pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.679803 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.679784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-tls-cert\") pod \"authorino-56fdd757f5-vxfxx\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") " pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.685814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.685791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjv6q\" (UniqueName: \"kubernetes.io/projected/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-kube-api-access-xjv6q\") pod \"authorino-56fdd757f5-vxfxx\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") " pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.701197 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.701171    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.701282 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.701175    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:06.714639 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.714620    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:06.717793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.717777    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:06.778307 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.778251    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-tls-cert\") pod \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") "
May 28 15:18:06.778307 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.778287    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9lmm\" (UniqueName: \"kubernetes.io/projected/ff142648-44fc-4845-a321-d55dbcc07fb7-kube-api-access-d9lmm\") pod \"ff142648-44fc-4845-a321-d55dbcc07fb7\" (UID: \"ff142648-44fc-4845-a321-d55dbcc07fb7\") "
May 28 15:18:06.778450 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.778346    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjv6q\" (UniqueName: \"kubernetes.io/projected/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-kube-api-access-xjv6q\") pod \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\" (UID: \"a8456f03-55c1-4d52-8e57-a5cfcd5d8930\") "
May 28 15:18:06.780308 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.780282    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a8456f03-55c1-4d52-8e57-a5cfcd5d8930" (UID: "a8456f03-55c1-4d52-8e57-a5cfcd5d8930"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 15:18:06.780370 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.780329    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff142648-44fc-4845-a321-d55dbcc07fb7-kube-api-access-d9lmm" (OuterVolumeSpecName: "kube-api-access-d9lmm") pod "ff142648-44fc-4845-a321-d55dbcc07fb7" (UID: "ff142648-44fc-4845-a321-d55dbcc07fb7"). InnerVolumeSpecName "kube-api-access-d9lmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:18:06.780414 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.780390    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-kube-api-access-xjv6q" (OuterVolumeSpecName: "kube-api-access-xjv6q") pod "a8456f03-55c1-4d52-8e57-a5cfcd5d8930" (UID: "a8456f03-55c1-4d52-8e57-a5cfcd5d8930"). InnerVolumeSpecName "kube-api-access-xjv6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:18:06.878974 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.878955    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-tls-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:18:06.878974 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.878975    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9lmm\" (UniqueName: \"kubernetes.io/projected/ff142648-44fc-4845-a321-d55dbcc07fb7-kube-api-access-d9lmm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:18:06.879110 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:06.878989    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjv6q\" (UniqueName: \"kubernetes.io/projected/a8456f03-55c1-4d52-8e57-a5cfcd5d8930-kube-api-access-xjv6q\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:18:07.703705 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:07.703676    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vxfxx"
May 28 15:18:07.703843 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:07.703683    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-49tg2"
May 28 15:18:07.736625 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:07.736594    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vxfxx"]
May 28 15:18:07.738747 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:07.738719    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vxfxx"]
May 28 15:18:07.758226 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:07.758200    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-49tg2"]
May 28 15:18:07.760795 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:07.760769    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-49tg2"]
May 28 15:18:08.697904 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:08.697875    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8456f03-55c1-4d52-8e57-a5cfcd5d8930" path="/var/lib/kubelet/pods/a8456f03-55c1-4d52-8e57-a5cfcd5d8930/volumes"
May 28 15:18:08.698132 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:08.698119    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff142648-44fc-4845-a321-d55dbcc07fb7" path="/var/lib/kubelet/pods/ff142648-44fc-4845-a321-d55dbcc07fb7/volumes"
May 28 15:18:10.998880 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:10.998842    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68b785cb4c-7qn6q"]
May 28 15:18:11.224736 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.224687    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68b785cb4c-7qn6q"]
May 28 15:18:11.224929 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.224823    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:11.227429 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.227404    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 15:18:11.227571 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.227404    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b4vq8\""
May 28 15:18:11.315109 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.315056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcnjp\" (UniqueName: \"kubernetes.io/projected/cab2abea-394d-4dc6-9647-1a82c5dc6836-kube-api-access-xcnjp\") pod \"maas-controller-68b785cb4c-7qn6q\" (UID: \"cab2abea-394d-4dc6-9647-1a82c5dc6836\") " pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:11.416337 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.416311    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcnjp\" (UniqueName: \"kubernetes.io/projected/cab2abea-394d-4dc6-9647-1a82c5dc6836-kube-api-access-xcnjp\") pod \"maas-controller-68b785cb4c-7qn6q\" (UID: \"cab2abea-394d-4dc6-9647-1a82c5dc6836\") " pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:11.424094 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.424068    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcnjp\" (UniqueName: \"kubernetes.io/projected/cab2abea-394d-4dc6-9647-1a82c5dc6836-kube-api-access-xcnjp\") pod \"maas-controller-68b785cb4c-7qn6q\" (UID: \"cab2abea-394d-4dc6-9647-1a82c5dc6836\") " pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:11.535304 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.535286    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:11.666262 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.666208    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68b785cb4c-7qn6q"]
May 28 15:18:11.668622 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:18:11.668590    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab2abea_394d_4dc6_9647_1a82c5dc6836.slice/crio-6b82d7083e22dbe22f8cf1a393da517db0df3aebc3d20352f43efce642a95292 WatchSource:0}: Error finding container 6b82d7083e22dbe22f8cf1a393da517db0df3aebc3d20352f43efce642a95292: Status 404 returned error can't find the container with id 6b82d7083e22dbe22f8cf1a393da517db0df3aebc3d20352f43efce642a95292
May 28 15:18:11.716892 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:11.716857    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b785cb4c-7qn6q" event={"ID":"cab2abea-394d-4dc6-9647-1a82c5dc6836","Type":"ContainerStarted","Data":"6b82d7083e22dbe22f8cf1a393da517db0df3aebc3d20352f43efce642a95292"}
May 28 15:18:14.729322 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:14.729280    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b785cb4c-7qn6q" event={"ID":"cab2abea-394d-4dc6-9647-1a82c5dc6836","Type":"ContainerStarted","Data":"ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169"}
May 28 15:18:14.729677 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:14.729421    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:14.745741 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:14.745699    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68b785cb4c-7qn6q" podStartSLOduration=2.245156284 podStartE2EDuration="4.745687931s" podCreationTimestamp="2026-05-28 15:18:10 +0000 UTC" firstStartedPulling="2026-05-28 15:18:11.671871355 +0000 UTC m=+631.605544238" lastFinishedPulling="2026-05-28 15:18:14.172402999 +0000 UTC m=+634.106075885" observedRunningTime="2026-05-28 15:18:14.744344218 +0000 UTC m=+634.678017109" watchObservedRunningTime="2026-05-28 15:18:14.745687931 +0000 UTC m=+634.679361226"
May 28 15:18:25.738400 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:25.738374    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:25.859866 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:25.859830    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68b785cb4c-7qn6q"]
May 28 15:18:25.860119 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:25.860079    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68b785cb4c-7qn6q" podUID="cab2abea-394d-4dc6-9647-1a82c5dc6836" containerName="manager" containerID="cri-o://ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169" gracePeriod=30
May 28 15:18:26.108449 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.108426    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:26.225476 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.225449    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcnjp\" (UniqueName: \"kubernetes.io/projected/cab2abea-394d-4dc6-9647-1a82c5dc6836-kube-api-access-xcnjp\") pod \"cab2abea-394d-4dc6-9647-1a82c5dc6836\" (UID: \"cab2abea-394d-4dc6-9647-1a82c5dc6836\") "
May 28 15:18:26.227664 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.227638    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab2abea-394d-4dc6-9647-1a82c5dc6836-kube-api-access-xcnjp" (OuterVolumeSpecName: "kube-api-access-xcnjp") pod "cab2abea-394d-4dc6-9647-1a82c5dc6836" (UID: "cab2abea-394d-4dc6-9647-1a82c5dc6836"). InnerVolumeSpecName "kube-api-access-xcnjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:18:26.326331 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.326277    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcnjp\" (UniqueName: \"kubernetes.io/projected/cab2abea-394d-4dc6-9647-1a82c5dc6836-kube-api-access-xcnjp\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
May 28 15:18:26.768166 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.768138    2562 generic.go:358] "Generic (PLEG): container finished" podID="cab2abea-394d-4dc6-9647-1a82c5dc6836" containerID="ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169" exitCode=0
May 28 15:18:26.768537 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.768222    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68b785cb4c-7qn6q"
May 28 15:18:26.768537 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.768221    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b785cb4c-7qn6q" event={"ID":"cab2abea-394d-4dc6-9647-1a82c5dc6836","Type":"ContainerDied","Data":"ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169"}
May 28 15:18:26.768537 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.768264    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b785cb4c-7qn6q" event={"ID":"cab2abea-394d-4dc6-9647-1a82c5dc6836","Type":"ContainerDied","Data":"6b82d7083e22dbe22f8cf1a393da517db0df3aebc3d20352f43efce642a95292"}
May 28 15:18:26.768537 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.768285    2562 scope.go:117] "RemoveContainer" containerID="ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169"
May 28 15:18:26.776670 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.776655    2562 scope.go:117] "RemoveContainer" containerID="ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169"
May 28 15:18:26.776895 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:18:26.776876    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169\": container with ID starting with ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169 not found: ID does not exist" containerID="ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169"
May 28 15:18:26.776942 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.776904    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169"} err="failed to get container status \"ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169\": rpc error: code = NotFound desc = could not find container \"ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169\": container with ID starting with ab5526e46eb571b6f23e42a624d8b00fed7309e5292ba6398d7b52fad60bd169 not found: ID does not exist"
May 28 15:18:26.784459 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.784438    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68b785cb4c-7qn6q"]
May 28 15:18:26.789512 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:26.789486    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68b785cb4c-7qn6q"]
May 28 15:18:28.697475 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:28.697444    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab2abea-394d-4dc6-9647-1a82c5dc6836" path="/var/lib/kubelet/pods/cab2abea-394d-4dc6-9647-1a82c5dc6836/volumes"
May 28 15:18:45.144388 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.144351    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6969b7446b-ptmr5"]
May 28 15:18:45.144750 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.144698    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab2abea-394d-4dc6-9647-1a82c5dc6836" containerName="manager"
May 28 15:18:45.144750 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.144710    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab2abea-394d-4dc6-9647-1a82c5dc6836" containerName="manager"
May 28 15:18:45.144819 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.144783    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="cab2abea-394d-4dc6-9647-1a82c5dc6836" containerName="manager"
May 28 15:18:45.150269 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.150250    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.152789 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.152770    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 15:18:45.152895 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.152846    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-74ftg\""
May 28 15:18:45.156054 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.156032    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6969b7446b-ptmr5"]
May 28 15:18:45.163174 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.163152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzlf\" (UniqueName: \"kubernetes.io/projected/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-kube-api-access-9hzlf\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.163282 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.163185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-maas-api-tls\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.264120 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.264093    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzlf\" (UniqueName: \"kubernetes.io/projected/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-kube-api-access-9hzlf\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.264211 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.264126    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-maas-api-tls\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.264254 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:18:45.264229    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 28 15:18:45.264287 ip-10-0-137-0 kubenswrapper[2562]: E0528 15:18:45.264275    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-maas-api-tls podName:771cf1f9-08eb-410f-bdc1-e0ba2b011cf1 nodeName:}" failed. No retries permitted until 2026-05-28 15:18:45.764261611 +0000 UTC m=+665.697934482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-maas-api-tls") pod "maas-api-6969b7446b-ptmr5" (UID: "771cf1f9-08eb-410f-bdc1-e0ba2b011cf1") : secret "maas-api-serving-cert" not found
May 28 15:18:45.273615 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.273599    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzlf\" (UniqueName: \"kubernetes.io/projected/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-kube-api-access-9hzlf\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.570595 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.570512    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-cl82r"]
May 28 15:18:45.573546 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.573530    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:18:45.575956 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.575937    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 15:18:45.584311 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.584291    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-cl82r"]
May 28 15:18:45.667725 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.667694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s725\" (UniqueName: \"kubernetes.io/projected/1b70da5f-69df-44b9-addd-abf7b0a18b52-kube-api-access-7s725\") pod \"payload-processing-58b6c8fdc7-cl82r\" (UID: \"1b70da5f-69df-44b9-addd-abf7b0a18b52\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:18:45.768736 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.768712    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7s725\" (UniqueName: \"kubernetes.io/projected/1b70da5f-69df-44b9-addd-abf7b0a18b52-kube-api-access-7s725\") pod \"payload-processing-58b6c8fdc7-cl82r\" (UID: \"1b70da5f-69df-44b9-addd-abf7b0a18b52\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:18:45.768894 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.768751    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-maas-api-tls\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.771262 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.771241    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/771cf1f9-08eb-410f-bdc1-e0ba2b011cf1-maas-api-tls\") pod \"maas-api-6969b7446b-ptmr5\" (UID: \"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1\") " pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:45.776408 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.776386    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s725\" (UniqueName: \"kubernetes.io/projected/1b70da5f-69df-44b9-addd-abf7b0a18b52-kube-api-access-7s725\") pod \"payload-processing-58b6c8fdc7-cl82r\" (UID: \"1b70da5f-69df-44b9-addd-abf7b0a18b52\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:18:45.884550 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:45.884522    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:18:46.014673 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:46.014641    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-cl82r"]
May 28 15:18:46.017921 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:18:46.017893    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b70da5f_69df_44b9_addd_abf7b0a18b52.slice/crio-009c7b276f231b8b19a312450d03df6909373ff890f30e69c549f460c2eb40fa WatchSource:0}: Error finding container 009c7b276f231b8b19a312450d03df6909373ff890f30e69c549f460c2eb40fa: Status 404 returned error can't find the container with id 009c7b276f231b8b19a312450d03df6909373ff890f30e69c549f460c2eb40fa
May 28 15:18:46.061294 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:46.061269    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:46.187689 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:46.187613    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6969b7446b-ptmr5"]
May 28 15:18:46.190228 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:18:46.190199    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771cf1f9_08eb_410f_bdc1_e0ba2b011cf1.slice/crio-2fc44f9d7692d7ce7ade954659e2e0748510390b4dc1e9312efc309bce70ea81 WatchSource:0}: Error finding container 2fc44f9d7692d7ce7ade954659e2e0748510390b4dc1e9312efc309bce70ea81: Status 404 returned error can't find the container with id 2fc44f9d7692d7ce7ade954659e2e0748510390b4dc1e9312efc309bce70ea81
May 28 15:18:46.832861 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:46.832818    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6969b7446b-ptmr5" event={"ID":"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1","Type":"ContainerStarted","Data":"2fc44f9d7692d7ce7ade954659e2e0748510390b4dc1e9312efc309bce70ea81"}
May 28 15:18:46.834167 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:46.834132    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r" event={"ID":"1b70da5f-69df-44b9-addd-abf7b0a18b52","Type":"ContainerStarted","Data":"009c7b276f231b8b19a312450d03df6909373ff890f30e69c549f460c2eb40fa"}
May 28 15:18:48.842043 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:48.841985    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6969b7446b-ptmr5" event={"ID":"771cf1f9-08eb-410f-bdc1-e0ba2b011cf1","Type":"ContainerStarted","Data":"5836197a7005c5affb2ca4726f77db71cdcb3ea2ff0505d87aacc970c9400b78"}
May 28 15:18:48.842457 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:48.842098    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:48.843444 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:48.843422    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r" event={"ID":"1b70da5f-69df-44b9-addd-abf7b0a18b52","Type":"ContainerStarted","Data":"a5f102b2ca409a19bffb815a349d07d92d0f1cd1d8a40a192d110210897ccc21"}
May 28 15:18:48.843548 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:48.843533    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:18:48.861939 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:48.861901    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6969b7446b-ptmr5" podStartSLOduration=1.34937311 podStartE2EDuration="3.861889839s" podCreationTimestamp="2026-05-28 15:18:45 +0000 UTC" firstStartedPulling="2026-05-28 15:18:46.191653376 +0000 UTC m=+666.125326248" lastFinishedPulling="2026-05-28 15:18:48.704170103 +0000 UTC m=+668.637842977" observedRunningTime="2026-05-28 15:18:48.861241784 +0000 UTC m=+668.794914682" watchObservedRunningTime="2026-05-28 15:18:48.861889839 +0000 UTC m=+668.795562731"
May 28 15:18:48.879817 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:48.879781    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r" podStartSLOduration=1.1497862460000001 podStartE2EDuration="3.879771655s" podCreationTimestamp="2026-05-28 15:18:45 +0000 UTC" firstStartedPulling="2026-05-28 15:18:46.019691283 +0000 UTC m=+665.953364154" lastFinishedPulling="2026-05-28 15:18:48.74967669 +0000 UTC m=+668.683349563" observedRunningTime="2026-05-28 15:18:48.878905503 +0000 UTC m=+668.812578397" watchObservedRunningTime="2026-05-28 15:18:48.879771655 +0000 UTC m=+668.813444547"
May 28 15:18:54.852715 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:54.852688    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6969b7446b-ptmr5"
May 28 15:18:59.848594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:18:59.848565    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-cl82r"
May 28 15:19:11.810182 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.810147    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"]
May 28 15:19:11.813394 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.813377    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.816884 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.816862    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 15:19:11.817034 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.816864    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jts6z\""
May 28 15:19:11.817034 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.816864    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 15:19:11.817034 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.816903    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 15:19:11.823720 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.823691    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"]
May 28 15:19:11.860589 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.860564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d4802db-530b-4e6d-8dc9-198a68237b30-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.860685 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.860592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxm6g\" (UniqueName: \"kubernetes.io/projected/7d4802db-530b-4e6d-8dc9-198a68237b30-kube-api-access-cxm6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.860685 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.860613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.860685 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.860639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.860793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.860706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.860793 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.860729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.961987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.961961    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962154 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.961999    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962154 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962154 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962080    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962335 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962224    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d4802db-530b-4e6d-8dc9-198a68237b30-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962335 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962255    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxm6g\" (UniqueName: \"kubernetes.io/projected/7d4802db-530b-4e6d-8dc9-198a68237b30-kube-api-access-cxm6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962443 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962496 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962457    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.962534 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.962493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.964309 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.964287    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d4802db-530b-4e6d-8dc9-198a68237b30-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.964697 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.964677    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d4802db-530b-4e6d-8dc9-198a68237b30-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:11.970599 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:11.970577    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxm6g\" (UniqueName: \"kubernetes.io/projected/7d4802db-530b-4e6d-8dc9-198a68237b30-kube-api-access-cxm6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s\" (UID: \"7d4802db-530b-4e6d-8dc9-198a68237b30\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:12.124921 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:12.124896    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:12.252782 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:12.252758    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"]
May 28 15:19:12.254611 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:19:12.254586    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4802db_530b_4e6d_8dc9_198a68237b30.slice/crio-7194cabefbd5f336dd9de806c5707be9f716da37d2d6283e190efb302cff1355 WatchSource:0}: Error finding container 7194cabefbd5f336dd9de806c5707be9f716da37d2d6283e190efb302cff1355: Status 404 returned error can't find the container with id 7194cabefbd5f336dd9de806c5707be9f716da37d2d6283e190efb302cff1355
May 28 15:19:12.924343 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:12.924310    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s" event={"ID":"7d4802db-530b-4e6d-8dc9-198a68237b30","Type":"ContainerStarted","Data":"7194cabefbd5f336dd9de806c5707be9f716da37d2d6283e190efb302cff1355"}
May 28 15:19:14.707704 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.707662    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"]
May 28 15:19:14.711594 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.711571    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.714245 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.714220    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 28 15:19:14.720455 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.720433    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"]
May 28 15:19:14.784595 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.784569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ktwx\" (UniqueName: \"kubernetes.io/projected/0e46bf75-7c05-4907-9d40-3a83f3efc18b-kube-api-access-8ktwx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.784702 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.784601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.784702 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.784625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.784772 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.784752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e46bf75-7c05-4907-9d40-3a83f3efc18b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.784811 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.784782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.784811 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.784804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886015 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.885982    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e46bf75-7c05-4907-9d40-3a83f3efc18b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886170 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886051    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886170 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886083    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886170 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886146    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ktwx\" (UniqueName: \"kubernetes.io/projected/0e46bf75-7c05-4907-9d40-3a83f3efc18b-kube-api-access-8ktwx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886350 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886177    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886350 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886240    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886575 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.886662 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.887036 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.886984    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.888795 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.888775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e46bf75-7c05-4907-9d40-3a83f3efc18b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.888900 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.888871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e46bf75-7c05-4907-9d40-3a83f3efc18b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:14.894387 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:14.894368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ktwx\" (UniqueName: \"kubernetes.io/projected/0e46bf75-7c05-4907-9d40-3a83f3efc18b-kube-api-access-8ktwx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-rgmfz\" (UID: \"0e46bf75-7c05-4907-9d40-3a83f3efc18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:15.024011 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:15.023948    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:15.150036 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:15.149995    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"]
May 28 15:19:15.152959 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:19:15.152931    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e46bf75_7c05_4907_9d40_3a83f3efc18b.slice/crio-5e7196f3798488be92c13d0d67ac29b4c0df6b66b7d6abcf310af363eac17572 WatchSource:0}: Error finding container 5e7196f3798488be92c13d0d67ac29b4c0df6b66b7d6abcf310af363eac17572: Status 404 returned error can't find the container with id 5e7196f3798488be92c13d0d67ac29b4c0df6b66b7d6abcf310af363eac17572
May 28 15:19:15.936469 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:15.936426    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz" event={"ID":"0e46bf75-7c05-4907-9d40-3a83f3efc18b","Type":"ContainerStarted","Data":"5e7196f3798488be92c13d0d67ac29b4c0df6b66b7d6abcf310af363eac17572"}
May 28 15:19:18.948685 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:18.948651    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s" event={"ID":"7d4802db-530b-4e6d-8dc9-198a68237b30","Type":"ContainerStarted","Data":"0e1033aa5c7aaa1b448599d1f54b9e375aa87406db70bb841079bf9a7d4a2b7d"}
May 28 15:19:18.950126 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:18.950087    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz" event={"ID":"0e46bf75-7c05-4907-9d40-3a83f3efc18b","Type":"ContainerStarted","Data":"5322c550b744ea8094483f73a10eb7f0d96c5c41616567caccd7505e4b99bd0d"}
May 28 15:19:23.967188 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:23.967150    2562 generic.go:358] "Generic (PLEG): container finished" podID="7d4802db-530b-4e6d-8dc9-198a68237b30" containerID="0e1033aa5c7aaa1b448599d1f54b9e375aa87406db70bb841079bf9a7d4a2b7d" exitCode=0
May 28 15:19:23.967555 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:23.967227    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s" event={"ID":"7d4802db-530b-4e6d-8dc9-198a68237b30","Type":"ContainerDied","Data":"0e1033aa5c7aaa1b448599d1f54b9e375aa87406db70bb841079bf9a7d4a2b7d"}
May 28 15:19:23.967894 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:23.967877    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:19:23.968627 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:23.968607    2562 generic.go:358] "Generic (PLEG): container finished" podID="0e46bf75-7c05-4907-9d40-3a83f3efc18b" containerID="5322c550b744ea8094483f73a10eb7f0d96c5c41616567caccd7505e4b99bd0d" exitCode=0
May 28 15:19:23.968674 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:23.968650    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz" event={"ID":"0e46bf75-7c05-4907-9d40-3a83f3efc18b","Type":"ContainerDied","Data":"5322c550b744ea8094483f73a10eb7f0d96c5c41616567caccd7505e4b99bd0d"}
May 28 15:19:25.976740 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:25.976701    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s" event={"ID":"7d4802db-530b-4e6d-8dc9-198a68237b30","Type":"ContainerStarted","Data":"b6e89b52b53710db167a6c701870d4107b2eccf2d3d7401b2c99d03e63a8a2db"}
May 28 15:19:25.977184 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:25.976926    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:19:25.978454 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:25.978432    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz" event={"ID":"0e46bf75-7c05-4907-9d40-3a83f3efc18b","Type":"ContainerStarted","Data":"bb94ae83d9c9e76f4a353af425c70fe02c7aebc637b33dc2f215b92291eff582"}
May 28 15:19:25.978621 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:25.978606    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:25.996573 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:25.996534    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s" podStartSLOduration=2.02162922 podStartE2EDuration="14.996522916s" podCreationTimestamp="2026-05-28 15:19:11 +0000 UTC" firstStartedPulling="2026-05-28 15:19:12.256387944 +0000 UTC m=+692.190060814" lastFinishedPulling="2026-05-28 15:19:25.231281625 +0000 UTC m=+705.164954510" observedRunningTime="2026-05-28 15:19:25.994860852 +0000 UTC m=+705.928533746" watchObservedRunningTime="2026-05-28 15:19:25.996522916 +0000 UTC m=+705.930195870"
May 28 15:19:26.011840 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:26.011796    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz" podStartSLOduration=1.942864386 podStartE2EDuration="12.011784658s" podCreationTimestamp="2026-05-28 15:19:14 +0000 UTC" firstStartedPulling="2026-05-28 15:19:15.155169 +0000 UTC m=+695.088841872" lastFinishedPulling="2026-05-28 15:19:25.224089256 +0000 UTC m=+705.157762144" observedRunningTime="2026-05-28 15:19:26.010732379 +0000 UTC m=+705.944405273" watchObservedRunningTime="2026-05-28 15:19:26.011784658 +0000 UTC m=+705.945457551"
May 28 15:19:36.995095 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:36.995059    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-rgmfz"
May 28 15:19:36.995987 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:19:36.995965    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s"
May 28 15:20:25.941377 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.941344    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bf8669d67-d7dtv"]
May 28 15:20:25.944829 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.944807    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:25.948718 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.948699    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 15:20:25.948969 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.948947    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 15:20:25.949098 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.948967    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lm6l6\""
May 28 15:20:25.949098 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.948988    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 15:20:25.952426 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:25.952403    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bf8669d67-d7dtv"]
May 28 15:20:26.033159 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.033124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71ee2269-1707-48c1-8130-017fb6808e84-tls-cert\") pod \"authorino-6bf8669d67-d7dtv\" (UID: \"71ee2269-1707-48c1-8130-017fb6808e84\") " pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.033296 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.033178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzks7\" (UniqueName: \"kubernetes.io/projected/71ee2269-1707-48c1-8130-017fb6808e84-kube-api-access-tzks7\") pod \"authorino-6bf8669d67-d7dtv\" (UID: \"71ee2269-1707-48c1-8130-017fb6808e84\") " pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.134243 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.134206    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71ee2269-1707-48c1-8130-017fb6808e84-tls-cert\") pod \"authorino-6bf8669d67-d7dtv\" (UID: \"71ee2269-1707-48c1-8130-017fb6808e84\") " pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.134354 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.134257    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzks7\" (UniqueName: \"kubernetes.io/projected/71ee2269-1707-48c1-8130-017fb6808e84-kube-api-access-tzks7\") pod \"authorino-6bf8669d67-d7dtv\" (UID: \"71ee2269-1707-48c1-8130-017fb6808e84\") " pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.136672 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.136653    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71ee2269-1707-48c1-8130-017fb6808e84-tls-cert\") pod \"authorino-6bf8669d67-d7dtv\" (UID: \"71ee2269-1707-48c1-8130-017fb6808e84\") " pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.142313 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.142289    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzks7\" (UniqueName: \"kubernetes.io/projected/71ee2269-1707-48c1-8130-017fb6808e84-kube-api-access-tzks7\") pod \"authorino-6bf8669d67-d7dtv\" (UID: \"71ee2269-1707-48c1-8130-017fb6808e84\") " pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.262406 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.262335    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bf8669d67-d7dtv"
May 28 15:20:26.386326 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:26.386294    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bf8669d67-d7dtv"]
May 28 15:20:26.389558 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:20:26.389534    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71ee2269_1707_48c1_8130_017fb6808e84.slice/crio-68f92b2822625f843b3f0286bcfb5ae1509cfc3a0ab0d50d929be4de78dacd25 WatchSource:0}: Error finding container 68f92b2822625f843b3f0286bcfb5ae1509cfc3a0ab0d50d929be4de78dacd25: Status 404 returned error can't find the container with id 68f92b2822625f843b3f0286bcfb5ae1509cfc3a0ab0d50d929be4de78dacd25
May 28 15:20:27.176174 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:27.176093    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bf8669d67-d7dtv" event={"ID":"71ee2269-1707-48c1-8130-017fb6808e84","Type":"ContainerStarted","Data":"cbbfb5d6feeeff94412301e0ca352ae19e64e395fbb50e55b17116daad69589a"}
May 28 15:20:27.176174 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:27.176132    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bf8669d67-d7dtv" event={"ID":"71ee2269-1707-48c1-8130-017fb6808e84","Type":"ContainerStarted","Data":"68f92b2822625f843b3f0286bcfb5ae1509cfc3a0ab0d50d929be4de78dacd25"}
May 28 15:20:27.196397 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:20:27.196347    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6bf8669d67-d7dtv" podStartSLOduration=1.72936644 podStartE2EDuration="2.196333328s" podCreationTimestamp="2026-05-28 15:20:25 +0000 UTC" firstStartedPulling="2026-05-28 15:20:26.391208446 +0000 UTC m=+766.324881319" lastFinishedPulling="2026-05-28 15:20:26.858175313 +0000 UTC m=+766.791848207" observedRunningTime="2026-05-28 15:20:27.194565019 +0000 UTC m=+767.128237922" watchObservedRunningTime="2026-05-28 15:20:27.196333328 +0000 UTC m=+767.130006221"
May 28 15:21:52.321547 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.321510    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-647584dd76-2v4ng"]
May 28 15:21:52.325032 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.325003    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:21:52.327467 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.327448    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 15:21:52.327597 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.327497    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b4vq8\""
May 28 15:21:52.334679 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.334656    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-647584dd76-2v4ng"]
May 28 15:21:52.412486 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.412459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwwl6\" (UniqueName: \"kubernetes.io/projected/987a9d0c-e550-4b42-aa49-22e605086157-kube-api-access-kwwl6\") pod \"maas-controller-647584dd76-2v4ng\" (UID: \"987a9d0c-e550-4b42-aa49-22e605086157\") " pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:21:52.513809 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.513783    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwwl6\" (UniqueName: \"kubernetes.io/projected/987a9d0c-e550-4b42-aa49-22e605086157-kube-api-access-kwwl6\") pod \"maas-controller-647584dd76-2v4ng\" (UID: \"987a9d0c-e550-4b42-aa49-22e605086157\") " pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:21:52.525718 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.525696    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwwl6\" (UniqueName: \"kubernetes.io/projected/987a9d0c-e550-4b42-aa49-22e605086157-kube-api-access-kwwl6\") pod \"maas-controller-647584dd76-2v4ng\" (UID: \"987a9d0c-e550-4b42-aa49-22e605086157\") " pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:21:52.636029 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.636004    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:21:52.766184 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:52.766159    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-647584dd76-2v4ng"]
May 28 15:21:52.769003 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:21:52.768966    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987a9d0c_e550_4b42_aa49_22e605086157.slice/crio-5fd0eeed6a70736077fca5c24790c9b9646ddf92ce2d8897288fd2a05c1a41ff WatchSource:0}: Error finding container 5fd0eeed6a70736077fca5c24790c9b9646ddf92ce2d8897288fd2a05c1a41ff: Status 404 returned error can't find the container with id 5fd0eeed6a70736077fca5c24790c9b9646ddf92ce2d8897288fd2a05c1a41ff
May 28 15:21:53.474041 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:53.473990    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-647584dd76-2v4ng" event={"ID":"987a9d0c-e550-4b42-aa49-22e605086157","Type":"ContainerStarted","Data":"2635067c2ae755cf9dc2540480de841f7c609c1dab38f81c4087b8c3dd4b3ae5"}
May 28 15:21:53.474410 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:53.474047    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-647584dd76-2v4ng" event={"ID":"987a9d0c-e550-4b42-aa49-22e605086157","Type":"ContainerStarted","Data":"5fd0eeed6a70736077fca5c24790c9b9646ddf92ce2d8897288fd2a05c1a41ff"}
May 28 15:21:53.474410 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:53.474072    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:21:53.491757 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:21:53.491674    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-647584dd76-2v4ng" podStartSLOduration=1.03395541 podStartE2EDuration="1.49165952s" podCreationTimestamp="2026-05-28 15:21:52 +0000 UTC" firstStartedPulling="2026-05-28 15:21:52.770328101 +0000 UTC m=+852.704000976" lastFinishedPulling="2026-05-28 15:21:53.228032202 +0000 UTC m=+853.161705086" observedRunningTime="2026-05-28 15:21:53.489131615 +0000 UTC m=+853.422804508" watchObservedRunningTime="2026-05-28 15:21:53.49165952 +0000 UTC m=+853.425332412"
May 28 15:22:04.483378 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:22:04.483345    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-647584dd76-2v4ng"
May 28 15:22:40.652144 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:22:40.652072    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:22:40.653574 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:22:40.653541    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:22:40.657718 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:22:40.657697    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:22:40.659067 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:22:40.659045    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:27:40.678297 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:27:40.678262    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:27:40.680867 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:27:40.680839    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:27:40.684390 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:27:40.684359    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:27:40.687132 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:27:40.687114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:32:40.707621 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:32:40.707573    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:32:40.712133 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:32:40.712110    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:32:40.714152 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:32:40.714130    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:32:40.718375 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:32:40.718357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:37:40.737550 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:37:40.737523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:37:40.741557 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:37:40.741530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:37:40.743560 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:37:40.743541    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:37:40.746961 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:37:40.746943    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:42:40.768102 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:40.768071    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:42:40.770769 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:40.770749    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:42:40.773436 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:40.773415    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:42:40.776429 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:40.776409    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:42:52.327800 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:52.327769    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bf8669d67-d7dtv_71ee2269-1707-48c1-8130-017fb6808e84/authorino/0.log"
May 28 15:42:56.798916 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:56.798880    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6969b7446b-ptmr5_771cf1f9-08eb-410f-bdc1-e0ba2b011cf1/maas-api/0.log"
May 28 15:42:57.039720 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:57.039694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-647584dd76-2v4ng_987a9d0c-e550-4b42-aa49-22e605086157/manager/0.log"
May 28 15:42:57.501469 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:57.501441    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c44ff6d8-rthmb_e720eece-5426-46e2-a014-141b3faddb96/manager/0.log"
May 28 15:42:57.609755 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:57.609729    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qfqgw_002989fd-a550-4f1d-b30a-ed981041993c/postgres/0.log"
May 28 15:42:58.861260 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:42:58.861232    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bf8669d67-d7dtv_71ee2269-1707-48c1-8130-017fb6808e84/authorino/0.log"
May 28 15:43:00.336481 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:00.336424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6697f59-jpjl2_13cc3b05-f9ea-4f48-8331-f7bebc114c7a/kube-auth-proxy/0.log"
May 28 15:43:00.570437 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:00.570414    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-cl82r_1b70da5f-69df-44b9-addd-abf7b0a18b52/payload-processing/0.log"
May 28 15:43:01.275136 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:01.275112    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-rgmfz_0e46bf75-7c05-4907-9d40-3a83f3efc18b/main/0.log"
May 28 15:43:01.282119 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:01.282091    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-rgmfz_0e46bf75-7c05-4907-9d40-3a83f3efc18b/storage-initializer/0.log"
May 28 15:43:01.387627 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:01.387595    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s_7d4802db-530b-4e6d-8dc9-198a68237b30/storage-initializer/0.log"
May 28 15:43:01.394182 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:01.394160    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccr8l7s_7d4802db-530b-4e6d-8dc9-198a68237b30/main/0.log"
May 28 15:43:08.539801 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:08.539773    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6bshc_0e9968b0-d208-489b-8213-a723d613a84a/global-pull-secret-syncer/0.log"
May 28 15:43:08.657666 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:08.657642    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r6vpj_8a47eaca-b1e4-4b34-8ba4-ea76cc479882/konnectivity-agent/0.log"
May 28 15:43:08.725069 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:08.725044    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-0.ec2.internal_2670e491eb4e43f6abb8d7eca0e403fa/haproxy/0.log"
May 28 15:43:12.640668 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:12.640643    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bf8669d67-d7dtv_71ee2269-1707-48c1-8130-017fb6808e84/authorino/0.log"
May 28 15:43:14.123244 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.123212    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/alertmanager/0.log"
May 28 15:43:14.153667 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.153638    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/config-reloader/0.log"
May 28 15:43:14.179827 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.179810    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/kube-rbac-proxy-web/0.log"
May 28 15:43:14.201777 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.201750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/kube-rbac-proxy/0.log"
May 28 15:43:14.227420 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.227400    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/kube-rbac-proxy-metric/0.log"
May 28 15:43:14.250358 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.250336    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/prom-label-proxy/0.log"
May 28 15:43:14.269306 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.269289    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e90e93c-3787-4fbd-af92-8e4d74c4ad6a/init-config-reloader/0.log"
May 28 15:43:14.364921 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.364896    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9jlvk_47fd9f3f-7e53-4212-8670-f4f32922f9bf/kube-state-metrics/0.log"
May 28 15:43:14.383994 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.383977    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9jlvk_47fd9f3f-7e53-4212-8670-f4f32922f9bf/kube-rbac-proxy-main/0.log"
May 28 15:43:14.408269 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.408254    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9jlvk_47fd9f3f-7e53-4212-8670-f4f32922f9bf/kube-rbac-proxy-self/0.log"
May 28 15:43:14.613248 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.613223    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5vz95_9f53ee4c-c970-4a6f-a722-c2568e8827ef/node-exporter/0.log"
May 28 15:43:14.634961 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.634945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5vz95_9f53ee4c-c970-4a6f-a722-c2568e8827ef/kube-rbac-proxy/0.log"
May 28 15:43:14.654741 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.654726    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5vz95_9f53ee4c-c970-4a6f-a722-c2568e8827ef/init-textfile/0.log"
May 28 15:43:14.850618 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.850590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/prometheus/0.log"
May 28 15:43:14.870827 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.870767    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/config-reloader/0.log"
May 28 15:43:14.892202 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.892179    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/thanos-sidecar/0.log"
May 28 15:43:14.910921 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.910901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/kube-rbac-proxy-web/0.log"
May 28 15:43:14.931526 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.931507    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/kube-rbac-proxy/0.log"
May 28 15:43:14.957533 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.957510    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/kube-rbac-proxy-thanos/0.log"
May 28 15:43:14.976424 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:14.976373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_235f9c2d-d801-4d8f-979d-89d39991d79e/init-config-reloader/0.log"
May 28 15:43:16.914231 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:16.914193    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"]
May 28 15:43:16.916462 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:16.916445    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:16.918748 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:16.918729    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xkl9v\"/\"default-dockercfg-vtnc5\""
May 28 15:43:16.918870 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:16.918774    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkl9v\"/\"openshift-service-ca.crt\""
May 28 15:43:16.919841 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:16.919818    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkl9v\"/\"kube-root-ca.crt\""
May 28 15:43:16.925648 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:16.925626    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"]
May 28 15:43:17.003219 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.003204    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/1.log"
May 28 15:43:17.008759 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.008742    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5zz9p_d7c6207a-78ab-411d-9807-f768a724347b/console-operator/2.log"
May 28 15:43:17.088516 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.088495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-lib-modules\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.088599 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.088543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-sys\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.088599 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.088560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whnhg\" (UniqueName: \"kubernetes.io/projected/70cddc31-8433-49cb-9897-5f73b09a0807-kube-api-access-whnhg\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.088671 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.088622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-podres\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.088705 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.088685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-proc\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190127    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-sys\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190162    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whnhg\" (UniqueName: \"kubernetes.io/projected/70cddc31-8433-49cb-9897-5f73b09a0807-kube-api-access-whnhg\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190205 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190184    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-podres\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190252    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-proc\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190265    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-sys\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190299    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-lib-modules\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-proc\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190402 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-podres\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.190555 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.190482    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70cddc31-8433-49cb-9897-5f73b09a0807-lib-modules\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.198219 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.198193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whnhg\" (UniqueName: \"kubernetes.io/projected/70cddc31-8433-49cb-9897-5f73b09a0807-kube-api-access-whnhg\") pod \"perf-node-gather-daemonset-6x7dt\" (UID: \"70cddc31-8433-49cb-9897-5f73b09a0807\") " pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.227189 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.227157    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.359681 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.359653    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"]
May 28 15:43:17.362264 ip-10-0-137-0 kubenswrapper[2562]: W0528 15:43:17.362236    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod70cddc31_8433_49cb_9897_5f73b09a0807.slice/crio-e387e62b15df5a998f2e6d989396e9db3521d4e86a6024955a0c2c076cbd259e WatchSource:0}: Error finding container e387e62b15df5a998f2e6d989396e9db3521d4e86a6024955a0c2c076cbd259e: Status 404 returned error can't find the container with id e387e62b15df5a998f2e6d989396e9db3521d4e86a6024955a0c2c076cbd259e
May 28 15:43:17.364053 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.364012    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:43:17.783072 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.782971    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt" event={"ID":"70cddc31-8433-49cb-9897-5f73b09a0807","Type":"ContainerStarted","Data":"6b231c34c22e5a2a7c86945d57a2c6df1d94cf421bd7ac8ac2dba3aba7139af0"}
May 28 15:43:17.783072 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.783013    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt" event={"ID":"70cddc31-8433-49cb-9897-5f73b09a0807","Type":"ContainerStarted","Data":"e387e62b15df5a998f2e6d989396e9db3521d4e86a6024955a0c2c076cbd259e"}
May 28 15:43:17.783072 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.783067    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:17.799476 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:17.799434    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt" podStartSLOduration=1.7994246139999999 podStartE2EDuration="1.799424614s" podCreationTimestamp="2026-05-28 15:43:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:43:17.797133136 +0000 UTC m=+2137.730806043" watchObservedRunningTime="2026-05-28 15:43:17.799424614 +0000 UTC m=+2137.733097507"
May 28 15:43:18.038578 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:18.038485    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-j4wjw_02b2d455-cd37-4197-b250-ce2d89d9e697/volume-data-source-validator/0.log"
May 28 15:43:18.773611 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:18.773566    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgvhq_27010090-9a69-4620-a81b-967332feec6b/dns/0.log"
May 28 15:43:18.792376 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:18.792352    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgvhq_27010090-9a69-4620-a81b-967332feec6b/kube-rbac-proxy/0.log"
May 28 15:43:18.915724 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:18.915696    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v79m4_a4648f74-0eab-4362-b95c-f41f3ac3253e/dns-node-resolver/0.log"
May 28 15:43:19.370065 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:19.370037    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-778f78ff99-pz5z2_0faba5ee-7420-4db7-8ead-74cacb660bad/registry/0.log"
May 28 15:43:19.377153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:19.377132    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-778f78ff99-pz5z2_0faba5ee-7420-4db7-8ead-74cacb660bad/registry/1.log"
May 28 15:43:19.416714 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:19.416676    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-df95z_6464f135-aaa3-4d79-b4ae-4e8d462333a3/node-ca/0.log"
May 28 15:43:20.321996 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:20.321956    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6697f59-jpjl2_13cc3b05-f9ea-4f48-8331-f7bebc114c7a/kube-auth-proxy/0.log"
May 28 15:43:20.464213 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:20.464171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-cl82r_1b70da5f-69df-44b9-addd-abf7b0a18b52/payload-processing/0.log"
May 28 15:43:21.001260 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:21.001221    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4x7t_f895dd66-5bc8-4831-a999-fc429510924f/serve-healthcheck-canary/0.log"
May 28 15:43:21.389603 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:21.389572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-8rhk7_fa9293a7-d63f-415d-8a43-a82e1053bcb5/insights-operator/0.log"
May 28 15:43:21.389603 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:21.389601    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-8rhk7_fa9293a7-d63f-415d-8a43-a82e1053bcb5/insights-operator/1.log"
May 28 15:43:21.407282 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:21.407238    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-85qfj_5a218a10-01e2-4a25-9c7f-47bd0668d5f0/kube-rbac-proxy/0.log"
May 28 15:43:21.428574 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:21.428556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-85qfj_5a218a10-01e2-4a25-9c7f-47bd0668d5f0/exporter/0.log"
May 28 15:43:21.448593 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:21.448576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-85qfj_5a218a10-01e2-4a25-9c7f-47bd0668d5f0/extractor/0.log"
May 28 15:43:23.354168 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:23.354134    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6969b7446b-ptmr5_771cf1f9-08eb-410f-bdc1-e0ba2b011cf1/maas-api/0.log"
May 28 15:43:23.447778 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:23.447750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-647584dd76-2v4ng_987a9d0c-e550-4b42-aa49-22e605086157/manager/0.log"
May 28 15:43:23.578540 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:23.578510    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57c44ff6d8-rthmb_e720eece-5426-46e2-a014-141b3faddb96/manager/0.log"
May 28 15:43:23.606008 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:23.605930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qfqgw_002989fd-a550-4f1d-b30a-ed981041993c/postgres/0.log"
May 28 15:43:23.796145 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:23.796119    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xkl9v/perf-node-gather-daemonset-6x7dt"
May 28 15:43:24.652469 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:24.652431    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5657b98b9f-jhnp8_73550f84-60ea-4bbe-8aa2-08e20cbbadd7/manager/0.log"
May 28 15:43:28.832141 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:28.832111    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-lg2c9_d6307546-6890-4b00-83c9-7a01cf66a4e0/migrator/0.log"
May 28 15:43:28.850666 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:28.850636    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-lg2c9_d6307546-6890-4b00-83c9-7a01cf66a4e0/graceful-termination/0.log"
May 28 15:43:30.084368 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.084339    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/kube-multus-additional-cni-plugins/0.log"
May 28 15:43:30.106814 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.106792    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/egress-router-binary-copy/0.log"
May 28 15:43:30.125444 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.125420    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/cni-plugins/0.log"
May 28 15:43:30.143447 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.143424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/bond-cni-plugin/0.log"
May 28 15:43:30.161683 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.161665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/routeoverride-cni/0.log"
May 28 15:43:30.181944 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.181925    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/whereabouts-cni-bincopy/0.log"
May 28 15:43:30.202434 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.202414    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lshn_db277cdc-530e-4b95-9e35-9ea0f4e609ce/whereabouts-cni/0.log"
May 28 15:43:30.559411 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.559382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mqp7m_7ddad515-f9c0-4f4e-999c-576cd0e7ec23/kube-multus/0.log"
May 28 15:43:30.661459 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.661432    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nvz75_523e2e5d-3908-45f1-bdad-676bee5d9082/network-metrics-daemon/0.log"
May 28 15:43:30.679842 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:30.679820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nvz75_523e2e5d-3908-45f1-bdad-676bee5d9082/kube-rbac-proxy/0.log"
May 28 15:43:31.450358 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.450332    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-controller/0.log"
May 28 15:43:31.466846 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.466820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/0.log"
May 28 15:43:31.477525 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.477506    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovn-acl-logging/1.log"
May 28 15:43:31.494314 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.494290    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/kube-rbac-proxy-node/0.log"
May 28 15:43:31.512753 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.512734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/kube-rbac-proxy-ovn-metrics/0.log"
May 28 15:43:31.530153 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.530132    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/northd/0.log"
May 28 15:43:31.548372 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.548357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/nbdb/0.log"
May 28 15:43:31.566921 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.566900    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/sbdb/0.log"
May 28 15:43:31.659613 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:31.659593    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvd87_47cd6e2c-0341-490e-b8cf-79420ab39cce/ovnkube-controller/0.log"
May 28 15:43:33.289066 ip-10-0-137-0 kubenswrapper[2562]: I0528 15:43:33.289013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dzrhm_9823d4aa-3041-4335-8bf0-81aed53a65e7/network-check-target-container/0.log"