May 27 18:35:51.233783 ip-10-0-142-149 systemd[1]: Starting Kubernetes Kubelet...
May 27 18:35:51.673878 ip-10-0-142-149 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 18:35:51.673878 ip-10-0-142-149 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 18:35:51.673878 ip-10-0-142-149 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 18:35:51.673878 ip-10-0-142-149 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 18:35:51.673878 ip-10-0-142-149 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 18:35:51.675666 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.675527    2571 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 18:35:51.681559 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681545    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 18:35:51.681559 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681558    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681562    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681565    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681569    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681571    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681574    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681577    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681579    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681582    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681584    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681587    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681589    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681593    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681595    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681598    2571 feature_gate.go:328] unrecognized feature gate: Example
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681601    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681603    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681606    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681608    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681611    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 18:35:51.681619 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681613    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681623    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681627    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681629    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681632    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681635    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681637    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681640    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681643    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681646    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681648    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681673    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681677    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681680    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681683    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681686    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681689    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681692    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681694    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681697    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 18:35:51.682088 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681699    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681703    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681707    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681710    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681713    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681716    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681720    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681723    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681726    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681728    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681731    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681734    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681736    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681739    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681743    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681746    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681749    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681751    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681754    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681757    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 18:35:51.682620 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681759    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681762    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681764    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681767    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681769    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681772    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681775    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681777    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681780    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681782    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681785    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681789    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681792    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681795    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681798    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681801    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681804    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681806    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681810    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 18:35:51.683144 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681813    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681816    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681819    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681821    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681824    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.681827    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682179    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682184    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682189    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682193    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682196    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682198    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682201    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682204    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682207    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682209    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682212    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682214    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682217    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 18:35:51.683612 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682220    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682222    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682225    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682227    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682230    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682232    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682235    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682237    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682241    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682244    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682246    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682249    2571 feature_gate.go:328] unrecognized feature gate: Example
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682252    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682254    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682257    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682260    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682262    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682265    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682267    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682270    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 18:35:51.684106 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682274    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682276    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682279    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682281    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682284    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682286    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682289    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682291    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682294    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682297    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682300    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682302    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682305    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682307    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682310    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682312    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682315    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682318    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682320    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682322    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 18:35:51.684635 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682325    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682328    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682332    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682335    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682338    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682340    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682343    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682345    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682348    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682351    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682353    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682356    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682359    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682361    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682364    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682367    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682369    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682372    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682374    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682377    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 18:35:51.685116 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682379    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682382    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682384    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682387    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682389    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682392    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682394    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682401    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682403    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682406    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682408    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682411    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.682414    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682493    2571 flags.go:64] FLAG: --address="0.0.0.0"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682505    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682528    2571 flags.go:64] FLAG: --anonymous-auth="true"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682535    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682541    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682547    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682551    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682556    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 18:35:51.685616 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682560    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682563    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682567    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682570    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682573    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682576    2571 flags.go:64] FLAG: --cgroup-root=""
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682579    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682582    2571 flags.go:64] FLAG: --client-ca-file=""
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682585    2571 flags.go:64] FLAG: --cloud-config=""
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682588    2571 flags.go:64] FLAG: --cloud-provider="external"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682591    2571 flags.go:64] FLAG: --cluster-dns="[]"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682596    2571 flags.go:64] FLAG: --cluster-domain=""
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682599    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682602    2571 flags.go:64] FLAG: --config-dir=""
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682605    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682608    2571 flags.go:64] FLAG: --container-log-max-files="5"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682612    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682615    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682619    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682623    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682626    2571 flags.go:64] FLAG: --contention-profiling="false"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682629    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682632    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682636    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682638    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 18:35:51.686117 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682648    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682651    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682654    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682657    2571 flags.go:64] FLAG: --enable-load-reader="false"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682660    2571 flags.go:64] FLAG: --enable-server="true"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682663    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682668    2571 flags.go:64] FLAG: --event-burst="100"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682671    2571 flags.go:64] FLAG: --event-qps="50"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682674    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682677    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682680    2571 flags.go:64] FLAG: --eviction-hard=""
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682683    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682686    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682689    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682692    2571 flags.go:64] FLAG: --eviction-soft=""
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682695    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682698    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682701    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682705    2571 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682708    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682710    2571 flags.go:64] FLAG: --fail-swap-on="true"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682713    2571 flags.go:64] FLAG: --feature-gates=""
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682717    2571 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682720    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682723    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 18:35:51.686729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682727    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682730    2571 flags.go:64] FLAG: --healthz-port="10248"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682733    2571 flags.go:64] FLAG: --help="false"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682737    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-142-149.ec2.internal"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682740    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682758    2571 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682785    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682790    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682796    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682799    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682802    2571 flags.go:64] FLAG: --image-service-endpoint=""
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682806    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682810    2571 flags.go:64] FLAG: --kube-api-burst="100"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682813    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682816    2571 flags.go:64] FLAG: --kube-api-qps="50"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682819    2571 flags.go:64] FLAG: --kube-reserved=""
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682824    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682826    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682830    2571 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682832    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682836    2571 flags.go:64] FLAG: --lock-file=""
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682839    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682842    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682845    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 18:35:51.687360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682861    2571 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682864    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682867    2571 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682870    2571 flags.go:64] FLAG: --logging-format="text"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682874    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682878    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682881    2571 flags.go:64] FLAG: --manifest-url=""
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682884    2571 flags.go:64] FLAG: --manifest-url-header=""
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682889    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682892    2571 flags.go:64] FLAG: --max-open-files="1000000"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682897    2571 flags.go:64] FLAG: --max-pods="110"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682900    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682903    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682906    2571 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682909    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682913    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682917    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682920    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682928    2571 flags.go:64] FLAG: --node-status-max-images="50"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682932    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682935    2571 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682938    2571 flags.go:64] FLAG: --pod-cidr=""
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682940    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 18:35:51.687965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682946    2571 flags.go:64] FLAG: --pod-manifest-path=""
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682949    2571 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682952    2571 flags.go:64] FLAG: --pods-per-core="0"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682955    2571 flags.go:64] FLAG: --port="10250"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682958    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682961    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a78ce427d81f187"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682965    2571 flags.go:64] FLAG: --qos-reserved=""
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682968    2571 flags.go:64] FLAG: --read-only-port="10255"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682971    2571 flags.go:64] FLAG: --register-node="true"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682974    2571 flags.go:64] FLAG: --register-schedulable="true"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682976    2571 flags.go:64] FLAG: --register-with-taints=""
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682980    2571 flags.go:64] FLAG: --registry-burst="10"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682983    2571 flags.go:64] FLAG: --registry-qps="5"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682986    2571 flags.go:64] FLAG: --reserved-cpus=""
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682989    2571 flags.go:64] FLAG: --reserved-memory=""
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682993    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682996    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.682999    2571 flags.go:64] FLAG: --rotate-certificates="false"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683002    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683005    2571 flags.go:64] FLAG: --runonce="false"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683008    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683011    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683014    2571 flags.go:64] FLAG: --seccomp-default="false"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683017    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683020    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683024    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 18:35:51.688531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683027    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683030    2571 flags.go:64] FLAG: --storage-driver-password="root"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683033    2571 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683036    2571 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683039    2571 flags.go:64] FLAG: --storage-driver-user="root"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683042    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683045    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683048    2571 flags.go:64] FLAG: --system-cgroups=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683051    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683057    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683060    2571 flags.go:64] FLAG: --tls-cert-file=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683063    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683068    2571 flags.go:64] FLAG: --tls-min-version=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683071    2571 flags.go:64] FLAG: --tls-private-key-file=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683074    2571 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683077    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683080    2571 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683083    2571 flags.go:64] FLAG: --v="2"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683087    2571 flags.go:64] FLAG: --version="false"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683091    2571 flags.go:64] FLAG: --vmodule=""
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683095    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.683099    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683193    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683196    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 18:35:51.689162 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683201    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683204    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683207    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683210    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683213    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683216    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683219    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683224    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683228    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683231    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683234    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683237    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683240    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683246    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683249    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683252    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683254    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683257    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683260    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 18:35:51.689784 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683263    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683266    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683269    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683271    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683274    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683277    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683279    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683282    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683284    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683287    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683290    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683292    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683295    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683297    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683300    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683302    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683305    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683307    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683313    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683316    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 18:35:51.690305 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683319    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683321    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683324    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683327    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683330    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683332    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683336    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683338    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683341    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683344    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683347    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683349    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683352    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683354    2571 feature_gate.go:328] unrecognized feature gate: Example
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683357    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683359    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683362    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683364    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683367    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683369    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 18:35:51.690811 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683372    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683374    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683377    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683379    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683382    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683385    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683387    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683389    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683392    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683394    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683398    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683401    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683404    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683406    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683409    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683412    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683415    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683417    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683421    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683424    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 18:35:51.691301 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683426    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683430    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683434    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683436    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.683439    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.684121    2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.690497    2571 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.690530    2571 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690578    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690583    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690587    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690590    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690594    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690597    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690600    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 18:35:51.691794 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690603    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690606    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690609    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690612    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690614    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690617    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690620    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690622    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690625    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690628    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690630    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690633    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690636    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690639    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690642    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690645    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690648    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690650    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690653    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690655    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 18:35:51.692170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690658    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690661    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690664    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690666    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690670    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690673    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690675    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690678    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690680    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690683    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690685    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690688    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690691    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690693    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690695    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690698    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690701    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690703    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690706    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 18:35:51.692670 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690708    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690711    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690713    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690716    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690718    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690721    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690724    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690727    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690730    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690732    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690735    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690737    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690740    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690743    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690746    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690749    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690751    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690754    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690757    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690760    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690762    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 18:35:51.693129 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690765    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690767    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690770    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690774    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690778    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690781    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690783    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690786    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690789    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690791    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690794    2571 feature_gate.go:328] unrecognized feature gate: Example
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690796    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690799    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690802    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690804    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690807    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690811    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690814    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 18:35:51.693745 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690818    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.690824    2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690916    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690920    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690924    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690927    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690930    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690933    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690936    2571 feature_gate.go:328] unrecognized feature gate: Example2
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690939    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690942    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690945    2571 feature_gate.go:328] unrecognized feature gate: Example
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690947    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690950    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690952    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 18:35:51.694180 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690955    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690957    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690960    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690962    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690965    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690967    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690970    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690972    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690975    2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690977    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690980    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690982    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690985    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690987    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690990    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690992    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690994    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.690997    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691000    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 18:35:51.694571 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691002    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691005    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691007    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691010    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691013    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691016    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691018    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691021    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691024    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691027    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691029    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691032    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691034    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691037    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691039    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691042    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691044    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691047    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691049    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691052    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 18:35:51.695016 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691054    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691057    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691059    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691062    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691064    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691067    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691069    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691072    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691074    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691076    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691079    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691082    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691085    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691087    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691090    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691092    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691095    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691097    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691100    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 18:35:51.695500 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691104    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691108    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691111    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691114    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691116    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691119    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691121    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691123    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691126    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691128    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691131    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691133    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691136    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691138    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:51.691141    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.691145    2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 18:35:51.695983 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.691899    2571 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 18:35:51.696365 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.693930    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 18:35:51.696365 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.694670    2571 server.go:1019] "Starting client certificate rotation"
May 27 18:35:51.696365 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.694774    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 18:35:51.696365 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.695438    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 18:35:51.718767 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.718750    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 18:35:51.723532 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.721408    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 18:35:51.740205 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.740186    2571 log.go:25] "Validated CRI v1 runtime API"
May 27 18:35:51.745723 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.745708    2571 log.go:25] "Validated CRI v1 image API"
May 27 18:35:51.747069 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.747048    2571 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 18:35:51.751664 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.751645    2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 18:35:51.752746 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.752726    2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9690ffe4-4c14-4fd6-915e-941e83b97785:/dev/nvme0n1p3 ae68e7ed-b894-495e-849f-a788cbeaa8bd:/dev/nvme0n1p4]
May 27 18:35:51.752787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.752747    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 18:35:51.757881 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.757781    2571 manager.go:217] Machine: {Timestamp:2026-05-27 18:35:51.757299354 +0000 UTC m=+0.407521941 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100235 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f800fdf55809cde1e44122c7730f7 SystemUUID:ec2f800f-df55-809c-de1e-44122c7730f7 BootID:75c4b1c4-7e87-4b6f-a3af-a9f4c78a0550 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:91:ec:13:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:91:ec:13:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:b2:0f:93:86:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 18:35:51.759408 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.759397    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 18:35:51.759488 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.759476    2571 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 18:35:51.762950 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.762923    2571 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 18:35:51.763086 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.762952    2571 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 18:35:51.763130 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.763096    2571 topology_manager.go:138] "Creating topology manager with none policy"
May 27 18:35:51.763130 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.763105    2571 container_manager_linux.go:306] "Creating device plugin manager"
May 27 18:35:51.763130 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.763116    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 18:35:51.764670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.764659    2571 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 18:35:51.766046 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.766036    2571 state_mem.go:36] "Initialized new in-memory state store"
May 27 18:35:51.766154 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.766145    2571 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 18:35:51.768498 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.768488    2571 kubelet.go:491] "Attempting to sync node with API server"
May 27 18:35:51.768554 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.768502    2571 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 18:35:51.768554 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.768526    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 18:35:51.768632 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.768556    2571 kubelet.go:397] "Adding apiserver pod source"
May 27 18:35:51.768632 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.768565    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 18:35:51.769551 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.769539    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 18:35:51.769596 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.769557    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 18:35:51.772334 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.772311    2571 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 18:35:51.774178 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.774164    2571 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 18:35:51.776095 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776082    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776099    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776105    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776112    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776121    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776127    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776133    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 18:35:51.776145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776138    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 18:35:51.776323 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776167    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 18:35:51.776323 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776174    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 18:35:51.776323 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776183    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 18:35:51.776323 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.776188    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 18:35:51.779306 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.779286    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 18:35:51.779386 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.779334    2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 18:35:51.783992 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.783975    2571 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 18:35:51.784071 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.784029    2571 server.go:1295] "Started kubelet"
May 27 18:35:51.784141 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.784096    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 18:35:51.784236 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.784126    2571 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 18:35:51.784282 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.784255    2571 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 18:35:51.784367 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.784352    2571 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 18:35:51.784537 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.784498    2571 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 18:35:51.784654 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.784635    2571 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 18:35:51.785027 ip-10-0-142-149 systemd[1]: Started Kubernetes Kubelet.
May 27 18:35:51.785484 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.785320    2571 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 18:35:51.786692 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.786679    2571 server.go:317] "Adding debug handlers to kubelet server"
May 27 18:35:51.789676 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.788698    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-149.ec2.internal.18b37ff13a55415d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-149.ec2.internal,UID:ip-10-0-142-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-149.ec2.internal,},FirstTimestamp:2026-05-27 18:35:51.783989597 +0000 UTC m=+0.434212186,LastTimestamp:2026-05-27 18:35:51.783989597 +0000 UTC m=+0.434212186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-149.ec2.internal,}"
May 27 18:35:51.792257 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.792236    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 18:35:51.792730 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.792711    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 18:35:51.792990 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.792970    2571 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 18:35:51.792990 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.792990    2571 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 18:35:51.793124 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793025    2571 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 18:35:51.793124 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793087    2571 reconstruct.go:97] "Volume reconstruction finished"
May 27 18:35:51.793124 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793099    2571 reconciler.go:26] "Reconciler: start to sync state"
May 27 18:35:51.793615 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793598    2571 factory.go:55] Registering systemd factory
May 27 18:35:51.793686 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793653    2571 factory.go:223] Registration of the systemd container factory successfully
May 27 18:35:51.793800 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.793783    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:51.793852 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793844    2571 factory.go:153] Registering CRI-O factory
May 27 18:35:51.793882 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793860    2571 factory.go:223] Registration of the crio container factory successfully
May 27 18:35:51.793926 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793914    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 18:35:51.793973 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793933    2571 factory.go:103] Registering Raw factory
May 27 18:35:51.793973 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.793945    2571 manager.go:1196] Started watching for new ooms in manager
May 27 18:35:51.794629 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.794614    2571 manager.go:319] Starting recovery of all containers
May 27 18:35:51.794735 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.794675    2571 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 18:35:51.795281 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.795255    2571 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 18:35:51.795393 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.795366    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 18:35:51.798354 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.797835    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bzwvl"
May 27 18:35:51.805339 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.805240    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bzwvl"
May 27 18:35:51.805339 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.805301    2571 manager.go:324] Recovery completed
May 27 18:35:51.806636 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.806620    2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 27 18:35:51.810307 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.810294    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 18:35:51.812039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.812024    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory"
May 27 18:35:51.812096 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.812051    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure"
May 27 18:35:51.812096 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.812061    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID"
May 27 18:35:51.812549 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.812534    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 18:35:51.812549 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.812548    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 18:35:51.812655 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.812563    2571 state_mem.go:36] "Initialized new in-memory state store"
May 27 18:35:51.814965 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.814951    2571 policy_none.go:49] "None policy: Start"
May 27 18:35:51.814999 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.814973    2571 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 18:35:51.814999 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.814987    2571 state_mem.go:35] "Initializing new in-memory state store"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.860622    2571 manager.go:341] "Starting Device Plugin manager"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.860650    2571 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.860660    2571 server.go:85] "Starting device plugin registration server"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.860891    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.860905    2571 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.861043    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.861118    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.861126    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.861555    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 18:35:51.862108 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.861585    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:51.961254 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.961160    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 18:35:51.962200 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.962177    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory"
May 27 18:35:51.962292 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.962210    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure"
May 27 18:35:51.962292 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.962222    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID"
May 27 18:35:51.962292 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.962248    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-149.ec2.internal"
May 27 18:35:51.970951 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.970935    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-149.ec2.internal"
May 27 18:35:51.971027 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.970959    2571 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-149.ec2.internal\": node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:51.979179 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.979153    2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 18:35:51.980418 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.980395    2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 18:35:51.980418 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.980417    2571 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 18:35:51.980596 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.980435    2571 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 18:35:51.980596 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.980441    2571 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 18:35:51.980596 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.980483    2571 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 18:35:51.987830 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:51.987814    2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 18:35:51.989589 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:51.989572    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.081019 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.080989    2571 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"]
May 27 18:35:52.081143 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.081097    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 18:35:52.082010 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.081993    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory"
May 27 18:35:52.082076 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.082024    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure"
May 27 18:35:52.082076 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.082035    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID"
May 27 18:35:52.083242 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083229    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 18:35:52.083407 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083391    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.083472 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083466    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 18:35:52.083909 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083891    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory"
May 27 18:35:52.083963 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083920    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure"
May 27 18:35:52.083963 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083930    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID"
May 27 18:35:52.083963 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083942    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory"
May 27 18:35:52.083963 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083962    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure"
May 27 18:35:52.084087 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.083971    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID"
May 27 18:35:52.085012 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.084999    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.085065 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.085023    2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 18:35:52.085666 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.085651    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory"
May 27 18:35:52.085749 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.085680    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure"
May 27 18:35:52.085749 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.085695    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID"
May 27 18:35:52.089675 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.089657    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.095681 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.095655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de69ad826fb42c5bf47806d9478423dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"de69ad826fb42c5bf47806d9478423dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.095768 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.095695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de69ad826fb42c5bf47806d9478423dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"de69ad826fb42c5bf47806d9478423dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.095768 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.095720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f048757d5dff142454cfd857a7c0883d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-149.ec2.internal\" (UID: \"f048757d5dff142454cfd857a7c0883d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.106056 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.106042    2571 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-149.ec2.internal\" not found" node="ip-10-0-142-149.ec2.internal"
May 27 18:35:52.110651 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.110634    2571 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-149.ec2.internal\" not found" node="ip-10-0-142-149.ec2.internal"
May 27 18:35:52.190250 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.190224    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.196627 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.196592    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de69ad826fb42c5bf47806d9478423dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"de69ad826fb42c5bf47806d9478423dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.196719 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.196638    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de69ad826fb42c5bf47806d9478423dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"de69ad826fb42c5bf47806d9478423dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.196719 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.196664    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f048757d5dff142454cfd857a7c0883d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-149.ec2.internal\" (UID: \"f048757d5dff142454cfd857a7c0883d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.196719 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.196695    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de69ad826fb42c5bf47806d9478423dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"de69ad826fb42c5bf47806d9478423dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.196719 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.196708    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de69ad826fb42c5bf47806d9478423dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"de69ad826fb42c5bf47806d9478423dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.196859 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.196695    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f048757d5dff142454cfd857a7c0883d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-149.ec2.internal\" (UID: \"f048757d5dff142454cfd857a7c0883d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.291032 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.290986    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.391509 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.391478    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.408898 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.408871    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.414451 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.414433    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.492070 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.492045    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.592624 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.592571    2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found"
May 27 18:35:52.594231 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.594216    2571 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 18:35:52.693331 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.693310    2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.695084 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.695071    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 18:35:52.695185 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.695170    2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 18:35:52.695222 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.695212    2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 18:35:52.695254 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.695221    2571 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://a0ec55def9e194d9cbab20b4234a04b0-81965bc7108b2db4.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.142.149:42206->44.209.240.178:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.695254 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.695242    2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"
May 27 18:35:52.711148 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.711133    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 18:35:52.769446 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.769422    2571 apiserver.go:52] "Watching apiserver"
May 27 18:35:52.776016 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.775991    2571 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 18:35:52.776296 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.776278    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal","openshift-multus/multus-additional-cni-plugins-jqr27","openshift-network-diagnostics/network-check-target-9pxq8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2","openshift-cluster-node-tuning-operator/tuned-sg92z","openshift-image-registry/node-ca-2lngs","openshift-multus/multus-stftg","openshift-multus/network-metrics-daemon-q6fb5","openshift-network-operator/iptables-alerter-wvwdk","openshift-ovn-kubernetes/ovnkube-node-bzrfx","kube-system/konnectivity-agent-kdkth"]
May 27 18:35:52.778298 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.778283    2571 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 18:35:52.778717 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.778701    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:52.778799 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.778779    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:35:52.779683 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.779669    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:52.779758 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.779727    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:35:52.780882 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.780865    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.780997 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.780974    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.783538 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.783503    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 18:35:52.784537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.783664    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7k8n\""
May 27 18:35:52.784537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.783778    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 18:35:52.784537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.783981    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.784537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.784007    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 18:35:52.784537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.784213    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 18:35:52.784537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.784372    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 18:35:52.785191 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.785174    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9ptpb\""
May 27 18:35:52.785350 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.785330    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 18:35:52.785408 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.785397    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.785484 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.785466    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 18:35:52.785621 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.785603    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 18:35:52.786090 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.786072    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 18:35:52.786317 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.786302    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hk4sv\""
May 27 18:35:52.786596 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.786582    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-stftg"
May 27 18:35:52.786673 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.786661    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.787844 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.787826    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 18:35:52.787948 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.787857    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 18:35:52.788013 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.787999    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.788295 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788137    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfqk5\""
May 27 18:35:52.788295 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788164    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 18:35:52.788295 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788209    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 18:35:52.788699 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788687    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 18:35:52.788801 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788786    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8h5jk\""
May 27 18:35:52.788843 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788828    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 18:35:52.788913 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.788867    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-js89b\""
May 27 18:35:52.789119 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.789107    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 18:35:52.789188 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.789176    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 18:35:52.789383 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.789370    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.790321 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790308    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c5t7q\""
May 27 18:35:52.790790 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790767    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 18:35:52.790790 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790776    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 18:35:52.790790 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790767    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 18:35:52.790959 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790787    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 18:35:52.790959 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790808    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 18:35:52.790959 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.790783    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 18:35:52.791229 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.791216    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 18:35:52.791484 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.791471    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 18:35:52.791625 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.791610    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7h8cq\""
May 27 18:35:52.792328 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.792316    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 18:35:52.793752 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.793737    2571 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 18:35:52.800016 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.799995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovn-node-metrics-cert\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.800109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-kubernetes\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-host\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.800109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-system-cni-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.800240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f-konnectivity-ca\") pod \"konnectivity-agent-kdkth\" (UID: \"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f\") " pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.800240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-system-cni-dir\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.800240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-sys-fs\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.800240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w684r\" (UniqueName: \"kubernetes.io/projected/64bd6f9b-189d-4deb-9124-b7bee468fd14-kube-api-access-w684r\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.800240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-serviceca\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.800405 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-socket-dir-parent\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.800405 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-systemd-units\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.800405 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800310    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovnkube-config\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.800405 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800338    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.800405 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800359    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-run\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800405 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-host\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/209d6a60-9132-4510-a33a-039144b387df-cni-binary-copy\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-cnibin\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-modprobe-d\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysctl-conf\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-sys\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th4ds\" (UniqueName: \"kubernetes.io/projected/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-kube-api-access-th4ds\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800602    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-systemd\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800637    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-hostroot\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.800662 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-etc-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-node-log\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-registration-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-lib-modules\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skwd\" (UniqueName: \"kubernetes.io/projected/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-kube-api-access-6skwd\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/209d6a60-9132-4510-a33a-039144b387df-multus-daemon-config\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-socket-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-var-lib-kubelet\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800855    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-iptables-alerter-script\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800875    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysctl-d\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-kubelet\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hszm6\" (UniqueName: \"kubernetes.io/projected/209d6a60-9132-4510-a33a-039144b387df-kube-api-access-hszm6\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800976    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-kubelet\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.800999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-cni-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801032    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-k8s-cni-cncf-io\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-conf-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801100    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovnkube-script-lib\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f-agent-certs\") pod \"konnectivity-agent-kdkth\" (UID: \"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f\") " pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-host-slash\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-etc-kubernetes\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801236    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-cni-netd\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-cnibin\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-cni-bin\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-ovn\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-netns\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-multus-certs\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-slash\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-tuned\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.801486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-cni-multus\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-cni-bin\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801496    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88m75\" (UniqueName: \"kubernetes.io/projected/8506e54f-c18d-4ab5-857b-b16e1de2861d-kube-api-access-88m75\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fddm\" (UniqueName: \"kubernetes.io/projected/3d7fbf16-8394-4c75-ac14-50fae454a40b-kube-api-access-5fddm\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801561    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysconfig\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801593    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a223801-5cc5-49f2-8e2e-7db5e42e921c-tmp\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-run-netns\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-systemd\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-os-release\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2w42\" (UniqueName: \"kubernetes.io/projected/720134c5-5c97-4281-b0df-ddc63fef983b-kube-api-access-s2w42\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7lz\" (UniqueName: \"kubernetes.io/projected/3a223801-5cc5-49f2-8e2e-7db5e42e921c-kube-api-access-hr7lz\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-var-lib-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-log-socket\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801889    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-env-overrides\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:52.802153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801917    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.802620 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-device-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.802620 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.801978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-os-release\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.804261 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.804245    2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 18:35:52.807095 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.807069    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 18:30:51 +0000 UTC" deadline="2027-10-25 14:50:17.890110017 +0000 UTC"
May 27 18:35:52.807095 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.807094    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12380h14m25.083017484s"
May 27 18:35:52.846766 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.846735    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-55lvl"
May 27 18:35:52.856664 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.856642    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-55lvl"
May 27 18:35:52.903012 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.902983    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-var-lib-kubelet\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.903109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903024    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-iptables-alerter-script\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.903109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903048    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysctl-d\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.903109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903072    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-kubelet\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903097    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hszm6\" (UniqueName: \"kubernetes.io/projected/209d6a60-9132-4510-a33a-039144b387df-kube-api-access-hszm6\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903121    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-kubelet\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903147    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-cni-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903169    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-k8s-cni-cncf-io\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903196    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-conf-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903219    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovnkube-script-lib\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903242    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f-agent-certs\") pod \"konnectivity-agent-kdkth\" (UID: \"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f\") " pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903266    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.903308 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903289    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-host-slash\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903311    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-etc-kubernetes\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903312    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysctl-d\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903335    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903357    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-cni-netd\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903381    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-cnibin\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903401    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903410    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-cni-bin\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903455    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-ovn\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903459    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-kubelet\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903490    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-netns\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903501    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-cni-netd\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903504    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903537    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-multus-certs\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903539    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-iptables-alerter-script\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903549    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-cni-bin\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903564    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-slash\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903568    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-etc-kubernetes\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.903670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903587    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-cni-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903589    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-cnibin\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903612    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-slash\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903622    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-ovn\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903610    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-var-lib-kubelet\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903459    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-host-slash\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903621    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-k8s-cni-cncf-io\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903661    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-conf-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903634    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903677    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-netns\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903660    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-run-multus-certs\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903701    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-tuned\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903588    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-kubelet\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903779    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-cni-multus\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903800    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-cni-bin\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903818    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88m75\" (UniqueName: \"kubernetes.io/projected/8506e54f-c18d-4ab5-857b-b16e1de2861d-kube-api-access-88m75\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903845    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fddm\" (UniqueName: \"kubernetes.io/projected/3d7fbf16-8394-4c75-ac14-50fae454a40b-kube-api-access-5fddm\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903869    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysconfig\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.904595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903892    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-cni-bin\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903897    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovnkube-script-lib\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903904    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a223801-5cc5-49f2-8e2e-7db5e42e921c-tmp\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903966    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-run-netns\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903963    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903983    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysconfig\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903990    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-systemd\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904019    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904031    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-run-netns\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904044    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-os-release\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904080    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-run-systemd\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904091    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2w42\" (UniqueName: \"kubernetes.io/projected/720134c5-5c97-4281-b0df-ddc63fef983b-kube-api-access-s2w42\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904119    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7lz\" (UniqueName: \"kubernetes.io/projected/3a223801-5cc5-49f2-8e2e-7db5e42e921c-kube-api-access-hr7lz\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904147    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-var-lib-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.903856    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-host-var-lib-cni-multus\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904173    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-log-socket\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904196    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-env-overrides\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904193    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-os-release\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.905480 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904230    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904257    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904266    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904282    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-device-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904321    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-var-lib-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.904357    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904366    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-device-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.904420    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:35:53.404401263 +0000 UTC m=+2.054623859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904508    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-log-socket\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904639    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-os-release\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904672    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovn-node-metrics-cert\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904696    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-kubernetes\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904721    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-host\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904745    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-system-cni-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904749    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-env-overrides\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904773    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f-konnectivity-ca\") pod \"konnectivity-agent-kdkth\" (UID: \"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f\") " pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904798    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-system-cni-dir\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.906355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904842    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-system-cni-dir\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904853    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-system-cni-dir\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904876    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904893    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-os-release\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904929    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-kubernetes\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904931    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-host\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904960    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-sys-fs\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.904999    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w684r\" (UniqueName: \"kubernetes.io/projected/64bd6f9b-189d-4deb-9124-b7bee468fd14-kube-api-access-w684r\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905038    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-serviceca\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905060    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-socket-dir-parent\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905095    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-systemd-units\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905129    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovnkube-config\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905177    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-multus-socket-dir-parent\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905228    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-systemd-units\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905307    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-sys-fs\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905331    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f-konnectivity-ca\") pod \"konnectivity-agent-kdkth\" (UID: \"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f\") " pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905354    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905399    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-run\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907145 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905433    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-serviceca\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905442    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-host\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905465    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/209d6a60-9132-4510-a33a-039144b387df-cni-binary-copy\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905490    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-run\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905491    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905539    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-cnibin\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905559    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-host\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905814    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-cnibin\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905686    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905730    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovnkube-config\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905777    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/720134c5-5c97-4281-b0df-ddc63fef983b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905783    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905566    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/720134c5-5c97-4281-b0df-ddc63fef983b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905902    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-modprobe-d\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905928    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysctl-conf\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905952    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-sys\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.905977    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th4ds\" (UniqueName: \"kubernetes.io/projected/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-kube-api-access-th4ds\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.907785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906003    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-systemd\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906027    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-hostroot\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906050    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-etc-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906073    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-node-log\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906097    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-registration-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906121    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906144    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-lib-modules\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906168    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6skwd\" (UniqueName: \"kubernetes.io/projected/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-kube-api-access-6skwd\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906191    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/209d6a60-9132-4510-a33a-039144b387df-multus-daemon-config\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906219    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906246    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-socket-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906229    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/209d6a60-9132-4510-a33a-039144b387df-cni-binary-copy\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906312    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-etc-openvswitch\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906382    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-socket-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906387    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-modprobe-d\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906432    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-node-log\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906474    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-sysctl-conf\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906576    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-lib-modules\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906832    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-sys\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906940    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/209d6a60-9132-4510-a33a-039144b387df-multus-daemon-config\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.907020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/209d6a60-9132-4510-a33a-039144b387df-hostroot\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.907074    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-systemd\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.906477    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-registration-dir\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.907145    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64bd6f9b-189d-4deb-9124-b7bee468fd14-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.907003    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8506e54f-c18d-4ab5-857b-b16e1de2861d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.907605    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a223801-5cc5-49f2-8e2e-7db5e42e921c-etc-tuned\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.907706    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8506e54f-c18d-4ab5-857b-b16e1de2861d-ovn-node-metrics-cert\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.908818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.908073    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f-agent-certs\") pod \"konnectivity-agent-kdkth\" (UID: \"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f\") " pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:52.909067 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.908919    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a223801-5cc5-49f2-8e2e-7db5e42e921c-tmp\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.915086 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.915065    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:35:52.915161 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.915093    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:35:52.915161 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.915106    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:52.915331 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:52.915166    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:35:53.415149837 +0000 UTC m=+2.065372429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:52.916331 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.916275    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hszm6\" (UniqueName: \"kubernetes.io/projected/209d6a60-9132-4510-a33a-039144b387df-kube-api-access-hszm6\") pod \"multus-stftg\" (UID: \"209d6a60-9132-4510-a33a-039144b387df\") " pod="openshift-multus/multus-stftg"
May 27 18:35:52.916560 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.916502    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88m75\" (UniqueName: \"kubernetes.io/projected/8506e54f-c18d-4ab5-857b-b16e1de2861d-kube-api-access-88m75\") pod \"ovnkube-node-bzrfx\" (UID: \"8506e54f-c18d-4ab5-857b-b16e1de2861d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:52.917085 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.917020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th4ds\" (UniqueName: \"kubernetes.io/projected/41b2dd3c-380a-41fa-acb0-f70b6e483f5f-kube-api-access-th4ds\") pod \"iptables-alerter-wvwdk\" (UID: \"41b2dd3c-380a-41fa-acb0-f70b6e483f5f\") " pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:52.917205 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.917189    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fddm\" (UniqueName: \"kubernetes.io/projected/3d7fbf16-8394-4c75-ac14-50fae454a40b-kube-api-access-5fddm\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:52.917909 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.917890    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skwd\" (UniqueName: \"kubernetes.io/projected/d94df2f4-b39d-4f3c-a26d-8f99aeba0382-kube-api-access-6skwd\") pod \"node-ca-2lngs\" (UID: \"d94df2f4-b39d-4f3c-a26d-8f99aeba0382\") " pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:52.918037 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.918020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w684r\" (UniqueName: \"kubernetes.io/projected/64bd6f9b-189d-4deb-9124-b7bee468fd14-kube-api-access-w684r\") pod \"aws-ebs-csi-driver-node-d6kc2\" (UID: \"64bd6f9b-189d-4deb-9124-b7bee468fd14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:52.918573 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.918556    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2w42\" (UniqueName: \"kubernetes.io/projected/720134c5-5c97-4281-b0df-ddc63fef983b-kube-api-access-s2w42\") pod \"multus-additional-cni-plugins-jqr27\" (UID: \"720134c5-5c97-4281-b0df-ddc63fef983b\") " pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:52.918646 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.918556    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7lz\" (UniqueName: \"kubernetes.io/projected/3a223801-5cc5-49f2-8e2e-7db5e42e921c-kube-api-access-hr7lz\") pod \"tuned-sg92z\" (UID: \"3a223801-5cc5-49f2-8e2e-7db5e42e921c\") " pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:52.928575 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:52.928548    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf048757d5dff142454cfd857a7c0883d.slice/crio-7c22db878247a3656bb96f054e1e39cc60a896a846c0c828dbfc60a40fa218a3 WatchSource:0}: Error finding container 7c22db878247a3656bb96f054e1e39cc60a896a846c0c828dbfc60a40fa218a3: Status 404 returned error can't find the container with id 7c22db878247a3656bb96f054e1e39cc60a896a846c0c828dbfc60a40fa218a3
May 27 18:35:52.928772 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:52.928754    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde69ad826fb42c5bf47806d9478423dd.slice/crio-7a0193cffedd52e7371cef322576aa64319a4f00b3e6026510fb58d67ff35b39 WatchSource:0}: Error finding container 7a0193cffedd52e7371cef322576aa64319a4f00b3e6026510fb58d67ff35b39: Status 404 returned error can't find the container with id 7a0193cffedd52e7371cef322576aa64319a4f00b3e6026510fb58d67ff35b39
May 27 18:35:52.933922 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.933904    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:35:52.983620 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.983576    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" event={"ID":"f048757d5dff142454cfd857a7c0883d","Type":"ContainerStarted","Data":"7c22db878247a3656bb96f054e1e39cc60a896a846c0c828dbfc60a40fa218a3"}
May 27 18:35:52.984451 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:52.984424    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" event={"ID":"de69ad826fb42c5bf47806d9478423dd","Type":"ContainerStarted","Data":"7a0193cffedd52e7371cef322576aa64319a4f00b3e6026510fb58d67ff35b39"}
May 27 18:35:53.116058 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.115993    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqr27"
May 27 18:35:53.117627 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.117613    2571 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 18:35:53.121883 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.121858    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720134c5_5c97_4281_b0df_ddc63fef983b.slice/crio-24f494c883f303d69e3cd72b619baac167d132ab80caf9c6cce8f2c7cdbd6f94 WatchSource:0}: Error finding container 24f494c883f303d69e3cd72b619baac167d132ab80caf9c6cce8f2c7cdbd6f94: Status 404 returned error can't find the container with id 24f494c883f303d69e3cd72b619baac167d132ab80caf9c6cce8f2c7cdbd6f94
May 27 18:35:53.134769 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.134748    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2"
May 27 18:35:53.146858 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.146844    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sg92z"
May 27 18:35:53.152545 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.152506    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a223801_5cc5_49f2_8e2e_7db5e42e921c.slice/crio-717f1a9e6a6b34412b4a951433eb1c8e4a2972d5d2fd0c6141c2190b51e9a95d WatchSource:0}: Error finding container 717f1a9e6a6b34412b4a951433eb1c8e4a2972d5d2fd0c6141c2190b51e9a95d: Status 404 returned error can't find the container with id 717f1a9e6a6b34412b4a951433eb1c8e4a2972d5d2fd0c6141c2190b51e9a95d
May 27 18:35:53.162289 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.162272    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2lngs"
May 27 18:35:53.167319 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.167296    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94df2f4_b39d_4f3c_a26d_8f99aeba0382.slice/crio-7d26b29431cf2a439f9e0547ae8009a557fbdb2de78d73d6de3d807756dc522a WatchSource:0}: Error finding container 7d26b29431cf2a439f9e0547ae8009a557fbdb2de78d73d6de3d807756dc522a: Status 404 returned error can't find the container with id 7d26b29431cf2a439f9e0547ae8009a557fbdb2de78d73d6de3d807756dc522a
May 27 18:35:53.168785 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.168762    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-stftg"
May 27 18:35:53.174952 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.174934    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209d6a60_9132_4510_a33a_039144b387df.slice/crio-b20568212582004fd6c085306a4551da2629b948ff3904e6822428a333b40491 WatchSource:0}: Error finding container b20568212582004fd6c085306a4551da2629b948ff3904e6822428a333b40491: Status 404 returned error can't find the container with id b20568212582004fd6c085306a4551da2629b948ff3904e6822428a333b40491
May 27 18:35:53.181174 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.181141    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvwdk"
May 27 18:35:53.186316 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.186295    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b2dd3c_380a_41fa_acb0_f70b6e483f5f.slice/crio-7a0cd3ab6f3254314d3391029e010d00d2be44cde790793544ed615fd73a6c39 WatchSource:0}: Error finding container 7a0cd3ab6f3254314d3391029e010d00d2be44cde790793544ed615fd73a6c39: Status 404 returned error can't find the container with id 7a0cd3ab6f3254314d3391029e010d00d2be44cde790793544ed615fd73a6c39
May 27 18:35:53.200264 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.200244    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:35:53.206170 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.206151    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8506e54f_c18d_4ab5_857b_b16e1de2861d.slice/crio-f40cd5ce2a45ffcad993a82cc1539a5fe6825448f7874799d1cbfd732373a1ab WatchSource:0}: Error finding container f40cd5ce2a45ffcad993a82cc1539a5fe6825448f7874799d1cbfd732373a1ab: Status 404 returned error can't find the container with id f40cd5ce2a45ffcad993a82cc1539a5fe6825448f7874799d1cbfd732373a1ab
May 27 18:35:53.208197 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.208150    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdkth"
May 27 18:35:53.214988 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:35:53.214972    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee794a5_97c8_4c3f_8d8e_2d59bdb4287f.slice/crio-636917a01c7d62c6130d17f290b030a642ca214fe23765b2a1ce146fd34beadd WatchSource:0}: Error finding container 636917a01c7d62c6130d17f290b030a642ca214fe23765b2a1ce146fd34beadd: Status 404 returned error can't find the container with id 636917a01c7d62c6130d17f290b030a642ca214fe23765b2a1ce146fd34beadd
May 27 18:35:53.409691 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.409589    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:53.409841 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:53.409716    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:53.409841 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:53.409766    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:35:54.409751274 +0000 UTC m=+3.059973847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:53.510699 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.510488    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:53.510699 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:53.510659    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:35:53.510699 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:53.510676    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:35:53.510699 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:53.510688    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:53.511019 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:53.510739    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:35:54.510722855 +0000 UTC m=+3.160945434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:53.857814 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.857656    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 18:30:52 +0000 UTC" deadline="2027-11-06 16:35:33.511380085 +0000 UTC"
May 27 18:35:53.857814 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.857702    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12669h59m39.653682694s"
May 27 18:35:53.997461 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:53.997384    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"f40cd5ce2a45ffcad993a82cc1539a5fe6825448f7874799d1cbfd732373a1ab"}
May 27 18:35:54.000899 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.000819    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2lngs" event={"ID":"d94df2f4-b39d-4f3c-a26d-8f99aeba0382","Type":"ContainerStarted","Data":"7d26b29431cf2a439f9e0547ae8009a557fbdb2de78d73d6de3d807756dc522a"}
May 27 18:35:54.005492 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.005347    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sg92z" event={"ID":"3a223801-5cc5-49f2-8e2e-7db5e42e921c","Type":"ContainerStarted","Data":"717f1a9e6a6b34412b4a951433eb1c8e4a2972d5d2fd0c6141c2190b51e9a95d"}
May 27 18:35:54.014726 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.014678    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2" event={"ID":"64bd6f9b-189d-4deb-9124-b7bee468fd14","Type":"ContainerStarted","Data":"a45a23a6a74ab3fb8d9f5459bbe0472773fc2b873693027bcb83f473d707492d"}
May 27 18:35:54.016826 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.016762    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdkth" event={"ID":"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f","Type":"ContainerStarted","Data":"636917a01c7d62c6130d17f290b030a642ca214fe23765b2a1ce146fd34beadd"}
May 27 18:35:54.020064 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.020020    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvwdk" event={"ID":"41b2dd3c-380a-41fa-acb0-f70b6e483f5f","Type":"ContainerStarted","Data":"7a0cd3ab6f3254314d3391029e010d00d2be44cde790793544ed615fd73a6c39"}
May 27 18:35:54.024263 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.024237    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-stftg" event={"ID":"209d6a60-9132-4510-a33a-039144b387df","Type":"ContainerStarted","Data":"b20568212582004fd6c085306a4551da2629b948ff3904e6822428a333b40491"}
May 27 18:35:54.032582 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.032558    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerStarted","Data":"24f494c883f303d69e3cd72b619baac167d132ab80caf9c6cce8f2c7cdbd6f94"}
May 27 18:35:54.152475 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.152201    2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 18:35:54.416184 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.415555    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:54.416184 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.415693    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:54.416184 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.415755    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:35:56.415738224 +0000 UTC m=+5.065960803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:54.516628 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.516584    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:54.516793 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.516751    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:35:54.516793 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.516771    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:35:54.516793 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.516784    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:54.516945 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.516840    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:35:56.516823515 +0000 UTC m=+5.167046091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:54.738894 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.738816    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-grtqd"]
May 27 18:35:54.740793 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.740770    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.744076 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.744055    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6rpc\""
May 27 18:35:54.744643 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.744419    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 18:35:54.745214 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.745195    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 18:35:54.818486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.818453    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edbe929-ca0b-4043-ac0e-76cdbf902714-tmp-dir\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.818648 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.818504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4edbe929-ca0b-4043-ac0e-76cdbf902714-hosts-file\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.818648 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.818593    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvmz5\" (UniqueName: \"kubernetes.io/projected/4edbe929-ca0b-4043-ac0e-76cdbf902714-kube-api-access-qvmz5\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.857876 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.857837    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 18:30:52 +0000 UTC" deadline="2027-11-11 13:43:23.532220939 +0000 UTC"
May 27 18:35:54.857876 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.857875    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12787h7m28.674349333s"
May 27 18:35:54.919479 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.919449    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmz5\" (UniqueName: \"kubernetes.io/projected/4edbe929-ca0b-4043-ac0e-76cdbf902714-kube-api-access-qvmz5\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.919654 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.919494    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edbe929-ca0b-4043-ac0e-76cdbf902714-tmp-dir\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.919654 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.919543    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4edbe929-ca0b-4043-ac0e-76cdbf902714-hosts-file\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.919654 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.919637    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4edbe929-ca0b-4043-ac0e-76cdbf902714-hosts-file\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.919904 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.919875    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edbe929-ca0b-4043-ac0e-76cdbf902714-tmp-dir\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.936289 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.936223    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvmz5\" (UniqueName: \"kubernetes.io/projected/4edbe929-ca0b-4043-ac0e-76cdbf902714-kube-api-access-qvmz5\") pod \"node-resolver-grtqd\" (UID: \"4edbe929-ca0b-4043-ac0e-76cdbf902714\") " pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:54.981125 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.981089    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:54.981268 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.981238    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:35:54.981700 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:54.981678    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:54.981782 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:54.981760    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:35:55.066498 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:55.066470    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grtqd"
May 27 18:35:55.091938 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:55.091892    2571 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 18:35:56.429800 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:56.429222    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:56.429800 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.429375    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:56.429800 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.429437    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:36:00.429417617 +0000 UTC m=+9.079640198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:35:56.529982 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:56.529940    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:56.530135 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.530104    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:35:56.530135 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.530123    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:35:56.530135 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.530136    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:56.530308 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.530200    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:36:00.5301826 +0000 UTC m=+9.180405180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:35:56.980908 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:56.980878    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:56.981088 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:56.980891    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:56.981088 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.981017    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:35:56.981088 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:56.981051    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:35:57.938367 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:57.938336    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bjlvl"]
May 27 18:35:57.940246 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:57.940224    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:57.940371 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:57.940316    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:35:58.042243 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.042200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59104cfc-293e-409b-9366-bbd2b5b991c5-dbus\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.042401 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.042263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59104cfc-293e-409b-9366-bbd2b5b991c5-kubelet-config\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.042401 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.042340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.143250    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.143314    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59104cfc-293e-409b-9366-bbd2b5b991c5-dbus\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.143349    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59104cfc-293e-409b-9366-bbd2b5b991c5-kubelet-config\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.143477    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59104cfc-293e-409b-9366-bbd2b5b991c5-kubelet-config\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:58.143568    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:58.143627    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret podName:59104cfc-293e-409b-9366-bbd2b5b991c5 nodeName:}" failed. No retries permitted until 2026-05-27 18:35:58.64360782 +0000 UTC m=+7.293830412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret") pod "global-pull-secret-syncer-bjlvl" (UID: "59104cfc-293e-409b-9366-bbd2b5b991c5") : object "kube-system"/"original-pull-secret" not registered
May 27 18:35:58.143647 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.143624    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59104cfc-293e-409b-9366-bbd2b5b991c5-dbus\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.648177 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.648134    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:58.648348 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:58.648296    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 18:35:58.648424 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:58.648375    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret podName:59104cfc-293e-409b-9366-bbd2b5b991c5 nodeName:}" failed. No retries permitted until 2026-05-27 18:35:59.648354462 +0000 UTC m=+8.298577037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret") pod "global-pull-secret-syncer-bjlvl" (UID: "59104cfc-293e-409b-9366-bbd2b5b991c5") : object "kube-system"/"original-pull-secret" not registered
May 27 18:35:58.981671 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.981107    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:35:58.981671 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:58.981107    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:35:58.981671 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:58.981247    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:35:58.981671 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:58.981303    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:35:59.656379 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:59.656339    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:59.656586 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:59.656487    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 18:35:59.656586 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:59.656570    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret podName:59104cfc-293e-409b-9366-bbd2b5b991c5 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:01.656551848 +0000 UTC m=+10.306774422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret") pod "global-pull-secret-syncer-bjlvl" (UID: "59104cfc-293e-409b-9366-bbd2b5b991c5") : object "kube-system"/"original-pull-secret" not registered
May 27 18:35:59.984694 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:35:59.984213    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:35:59.984694 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:35:59.984354    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:00.463661 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:00.463627    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:00.463844 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.463766    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:36:00.463844 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.463823    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:36:08.46380626 +0000 UTC m=+17.114028839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:36:00.565080 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:00.564974    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:00.565286 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.565151    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:36:00.565286 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.565176    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:36:00.565286 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.565189    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:36:00.565286 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.565253    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:36:08.565233384 +0000 UTC m=+17.215455961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:36:00.981207 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:00.980607    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:00.981207 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:00.980624    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:00.981207 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.980730    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:00.981207 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:00.981158    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:01.674153 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:01.674112    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:01.674598 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:01.674260    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 18:36:01.674598 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:01.674329    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret podName:59104cfc-293e-409b-9366-bbd2b5b991c5 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:05.674311043 +0000 UTC m=+14.324533634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret") pod "global-pull-secret-syncer-bjlvl" (UID: "59104cfc-293e-409b-9366-bbd2b5b991c5") : object "kube-system"/"original-pull-secret" not registered
May 27 18:36:01.982026 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:01.981840    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:01.982026 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:01.981952    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:02.980891 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:02.980863    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:02.981302 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:02.980863    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:02.981302 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:02.980979    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:02.981302 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:02.981076    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:03.981652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:03.981620    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:03.982076 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:03.981796    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:04.980910 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:04.980873    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:04.981095 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:04.980873    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:04.981095 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:04.980990    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:04.981211 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:04.981089    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:05.703011 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:05.702978    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:05.703394 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:05.703126    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 18:36:05.703394 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:05.703190    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret podName:59104cfc-293e-409b-9366-bbd2b5b991c5 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:13.703175238 +0000 UTC m=+22.353397811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret") pod "global-pull-secret-syncer-bjlvl" (UID: "59104cfc-293e-409b-9366-bbd2b5b991c5") : object "kube-system"/"original-pull-secret" not registered
May 27 18:36:05.980681 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:05.980605    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:05.980835 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:05.980724    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:06.980611 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:06.980582    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:06.980983 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:06.980582    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:06.980983 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:06.980704    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:06.980983 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:06.980810    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:07.980889 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:07.980857    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:07.981343 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:07.980964    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:08.524804 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:08.524767    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:08.525008 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.524878    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:36:08.525008 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.524935    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:36:24.524914931 +0000 UTC m=+33.175137506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:36:08.625882 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:08.625840    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:08.626029 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.625992    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:36:08.626029 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.626016    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:36:08.626029 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.626028    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:36:08.626178 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.626078    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:36:24.626062695 +0000 UTC m=+33.276285279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:36:08.980771 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:08.980703    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:08.980912 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:08.980703    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:08.980912 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.980818    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:08.981259 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:08.980908    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:09.980738 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:09.980702    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:09.980906 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:09.980823    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:10.981399 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:10.981365    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:10.981845 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:10.981368    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:10.981845 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:10.981481    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:10.981845 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:10.981613    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:11.114536 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:36:11.114485    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edbe929_ca0b_4043_ac0e_76cdbf902714.slice/crio-15e4e02001905a8e3572b3e0bbcd652f51d63d1c3d8147914b78300ae012a8cc WatchSource:0}: Error finding container 15e4e02001905a8e3572b3e0bbcd652f51d63d1c3d8147914b78300ae012a8cc: Status 404 returned error can't find the container with id 15e4e02001905a8e3572b3e0bbcd652f51d63d1c3d8147914b78300ae012a8cc
May 27 18:36:11.982078 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:11.981629    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:11.982078 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:11.981933    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:12.062080 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.061914    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-stftg" event={"ID":"209d6a60-9132-4510-a33a-039144b387df","Type":"ContainerStarted","Data":"ab533b251f1bb9f77e340e2beb514f8f047428d13e06124161d0f92208d08e7d"}
May 27 18:36:12.063129 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.063109    2571 generic.go:358] "Generic (PLEG): container finished" podID="720134c5-5c97-4281-b0df-ddc63fef983b" containerID="5244a3b14609bbcc2613e498e89d7da84ad738ad9607cf20b4e0389d292f42b2" exitCode=0
May 27 18:36:12.063190 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.063170    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerDied","Data":"5244a3b14609bbcc2613e498e89d7da84ad738ad9607cf20b4e0389d292f42b2"}
May 27 18:36:12.064849 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.064828    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grtqd" event={"ID":"4edbe929-ca0b-4043-ac0e-76cdbf902714","Type":"ContainerStarted","Data":"dfd58a0047a7eecd007e51cb05d139a5db67289d66b8a05bbf3b711953762e55"}
May 27 18:36:12.064926 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.064857    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grtqd" event={"ID":"4edbe929-ca0b-4043-ac0e-76cdbf902714","Type":"ContainerStarted","Data":"15e4e02001905a8e3572b3e0bbcd652f51d63d1c3d8147914b78300ae012a8cc"}
May 27 18:36:12.066371 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.066347    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" event={"ID":"f048757d5dff142454cfd857a7c0883d","Type":"ContainerStarted","Data":"9446db962b6918e609d85d13116e3f55d3c0665991de84166032663545780e61"}
May 27 18:36:12.068609 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.068589    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"0023619543df706ed769f41c2e8b892541fc6b977ec888a554455586d63e5a23"}
May 27 18:36:12.068673 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.068616    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"b81cc627c084eac77884dcbcd3c3fc4dcf08108ff6737370919b5d6bada9ca6e"}
May 27 18:36:12.068673 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.068633    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"be84c8d1c38e92c3dbaa7537724d790b96c42335c8a694ea9e7ef0e19204eb6f"}
May 27 18:36:12.068673 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.068643    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"8468eb309b6e15b13b9ffaa31373779adf8a468818bbc485fd685e63b7205360"}
May 27 18:36:12.068673 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.068654    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"03bded941e164f4070b3e4d5106ee2dd948973ca738b2c08f31f161af1462049"}
May 27 18:36:12.069753 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.069732    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2lngs" event={"ID":"d94df2f4-b39d-4f3c-a26d-8f99aeba0382","Type":"ContainerStarted","Data":"ef74a9043eb26a8ea8315302cde667806fd88dcab19b07bc93a293163cdb60cb"}
May 27 18:36:12.070828 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.070811    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sg92z" event={"ID":"3a223801-5cc5-49f2-8e2e-7db5e42e921c","Type":"ContainerStarted","Data":"53cfa7ee54ef70ca81c100d8461fe804a0a6f413aa0fc53a5861915b23c8e328"}
May 27 18:36:12.071918 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.071883    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2" event={"ID":"64bd6f9b-189d-4deb-9124-b7bee468fd14","Type":"ContainerStarted","Data":"3b31f953d06d54783464480e9be6b72ec42ee5bb472db8f002663c2ac410aaec"}
May 27 18:36:12.072960 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.072940    2571 generic.go:358] "Generic (PLEG): container finished" podID="de69ad826fb42c5bf47806d9478423dd" containerID="640145d1d89505fe74b5946128e8673efd095e633416728650f5bcfcfbfd91fb" exitCode=0
May 27 18:36:12.073040 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.073006    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" event={"ID":"de69ad826fb42c5bf47806d9478423dd","Type":"ContainerDied","Data":"640145d1d89505fe74b5946128e8673efd095e633416728650f5bcfcfbfd91fb"}
May 27 18:36:12.074136 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.074117    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdkth" event={"ID":"5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f","Type":"ContainerStarted","Data":"71307c21ee81f1aaa6e27c4b4f88779a44fae333a3fd20949ef4f915b246b90f"}
May 27 18:36:12.079626 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.079591    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-stftg" podStartSLOduration=1.615743677 podStartE2EDuration="20.079579971s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.176501131 +0000 UTC m=+1.826723704" lastFinishedPulling="2026-05-27 18:36:11.640337424 +0000 UTC m=+20.290559998" observedRunningTime="2026-05-27 18:36:12.079202196 +0000 UTC m=+20.729424803" watchObservedRunningTime="2026-05-27 18:36:12.079579971 +0000 UTC m=+20.729802565"
May 27 18:36:12.091526 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.091483    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdkth" podStartSLOduration=2.135705133 podStartE2EDuration="20.091474937s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.216215852 +0000 UTC m=+1.866438426" lastFinishedPulling="2026-05-27 18:36:11.171985641 +0000 UTC m=+19.822208230" observedRunningTime="2026-05-27 18:36:12.091062764 +0000 UTC m=+20.741285372" watchObservedRunningTime="2026-05-27 18:36:12.091474937 +0000 UTC m=+20.741697531"
May 27 18:36:12.102665 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.102637    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-grtqd" podStartSLOduration=18.102627311 podStartE2EDuration="18.102627311s" podCreationTimestamp="2026-05-27 18:35:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:36:12.102473542 +0000 UTC m=+20.752696137" watchObservedRunningTime="2026-05-27 18:36:12.102627311 +0000 UTC m=+20.752849905"
May 27 18:36:12.143473 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.143442    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" podStartSLOduration=20.143433495 podStartE2EDuration="20.143433495s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:36:12.143386994 +0000 UTC m=+20.793609582" watchObservedRunningTime="2026-05-27 18:36:12.143433495 +0000 UTC m=+20.793656090"
May 27 18:36:12.143734 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.143709    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2lngs" podStartSLOduration=1.7686802780000002 podStartE2EDuration="20.143704347s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.170956662 +0000 UTC m=+1.821179235" lastFinishedPulling="2026-05-27 18:36:11.545980719 +0000 UTC m=+20.196203304" observedRunningTime="2026-05-27 18:36:12.130302123 +0000 UTC m=+20.780524717" watchObservedRunningTime="2026-05-27 18:36:12.143704347 +0000 UTC m=+20.793926942"
May 27 18:36:12.981311 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.981282    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:12.981597 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:12.981288    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:12.981597 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:12.981418    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:12.981597 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:12.981488    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:13.077410 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.077379    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvwdk" event={"ID":"41b2dd3c-380a-41fa-acb0-f70b6e483f5f","Type":"ContainerStarted","Data":"73edd4abe8a7728d9b9f52a24ca15d4ade6ba1a5c6ce0421d884cc3fe2e08d73"}
May 27 18:36:13.080367 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.080313    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"7823324c2197cb5fb98e0353054bd02f92bb6bccd3aecae7cbc4f1bcf5a85a45"}
May 27 18:36:13.080996 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.080856    2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"
May 27 18:36:13.090585 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.090550    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sg92z" podStartSLOduration=3.072174817 podStartE2EDuration="21.090534651s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.153869212 +0000 UTC m=+1.804091785" lastFinishedPulling="2026-05-27 18:36:11.172229041 +0000 UTC m=+19.822451619" observedRunningTime="2026-05-27 18:36:12.157223944 +0000 UTC m=+20.807446547" watchObservedRunningTime="2026-05-27 18:36:13.090534651 +0000 UTC m=+21.740757244"
May 27 18:36:13.090840 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.090807    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wvwdk" podStartSLOduration=2.73166334 podStartE2EDuration="21.090801683s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.187654783 +0000 UTC m=+1.837877357" lastFinishedPulling="2026-05-27 18:36:11.546793108 +0000 UTC m=+20.197015700" observedRunningTime="2026-05-27 18:36:13.090366194 +0000 UTC m=+21.740588793" watchObservedRunningTime="2026-05-27 18:36:13.090801683 +0000 UTC m=+21.741024279"
May 27 18:36:13.093357 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.093337    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 18:36:13.094198 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.094163    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal"]
May 27 18:36:13.119109 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.119087    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 18:36:13.764806 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.764777    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:13.765079 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:13.764899    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 18:36:13.765079 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:13.764964    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret podName:59104cfc-293e-409b-9366-bbd2b5b991c5 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:29.764945076 +0000 UTC m=+38.415167653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret") pod "global-pull-secret-syncer-bjlvl" (UID: "59104cfc-293e-409b-9366-bbd2b5b991c5") : object "kube-system"/"original-pull-secret" not registered
May 27 18:36:13.873286 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.873185    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T18:36:13.11910752Z","UUID":"de3a28c7-333e-4b56-930c-9840ec33f856","Handler":null,"Name":"","Endpoint":""}
May 27 18:36:13.874855 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.874831    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 18:36:13.874855 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.874857    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 18:36:13.981201 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:13.981163    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:13.981363 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:13.981292    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:14.084006 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:14.083971    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" event={"ID":"de69ad826fb42c5bf47806d9478423dd","Type":"ContainerStarted","Data":"8786dab125d38851b74858f766be03851669ea1a7f6d057b673732b7ba5b9087"}
May 27 18:36:14.085690 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:14.085664    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2" event={"ID":"64bd6f9b-189d-4deb-9124-b7bee468fd14","Type":"ContainerStarted","Data":"3dc12c053a9e83e4db015561918da9181da3d63faacbc1e21ed5a1220dd1c298"}
May 27 18:36:14.114831 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:14.114777    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" podStartSLOduration=1.114757 podStartE2EDuration="1.114757s" podCreationTimestamp="2026-05-27 18:36:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:36:14.109928192 +0000 UTC m=+22.760150788" watchObservedRunningTime="2026-05-27 18:36:14.114757 +0000 UTC m=+22.764979595"
May 27 18:36:14.981458 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:14.981431    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:14.981458 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:14.981459    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:14.981690 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:14.981535    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:14.981690 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:14.981663    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:15.090676 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:15.090642    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"cd06c014e1926834e51fb7e7ccf083bee175045cc679dfb7b1b6d93ae4c9b3d6"}
May 27 18:36:15.092534 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:15.092483    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2" event={"ID":"64bd6f9b-189d-4deb-9124-b7bee468fd14","Type":"ContainerStarted","Data":"76d080db6924e52c141de200ccb9bee9b718a5737d83a568817618345a553053"}
May 27 18:36:15.113115 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:15.113066    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6kc2" podStartSLOduration=2.253638569 podStartE2EDuration="23.113053737s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.141605084 +0000 UTC m=+1.791827663" lastFinishedPulling="2026-05-27 18:36:14.001020238 +0000 UTC m=+22.651242831" observedRunningTime="2026-05-27 18:36:15.112603116 +0000 UTC m=+23.762825715" watchObservedRunningTime="2026-05-27 18:36:15.113053737 +0000 UTC m=+23.763276333"
May 27 18:36:15.287459 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:15.287429    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdkth"
May 27 18:36:15.288143 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:15.288119    2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdkth"
May 27 18:36:15.983123 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:15.983098    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:15.983280 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:15.983190    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:16.093973 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:16.093947    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdkth"
May 27 18:36:16.094386 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:16.094370    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdkth"
May 27 18:36:16.981713 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:16.981556    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:16.981849 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:16.981555    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:16.981849 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:16.981787    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:16.981930 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:16.981867    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:17.097172 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:17.097148    2571 generic.go:358] "Generic (PLEG): container finished" podID="720134c5-5c97-4281-b0df-ddc63fef983b" containerID="7cad7c26f94f8d1618af09b3982e18c3fd5e6ffe3ba91e81ce626896242d6ff4" exitCode=0
May 27 18:36:17.097942 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:17.097217    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerDied","Data":"7cad7c26f94f8d1618af09b3982e18c3fd5e6ffe3ba91e81ce626896242d6ff4"}
May 27 18:36:17.100368 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:17.100347    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" event={"ID":"8506e54f-c18d-4ab5-857b-b16e1de2861d","Type":"ContainerStarted","Data":"3cd0d051eca038d37069e7af69a2cc825d1984d12944ffe73db5200cd0e1cb8c"}
May 27 18:36:17.154945 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:17.154907    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx" podStartSLOduration=6.778123961 podStartE2EDuration="25.154896857s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.209065411 +0000 UTC m=+1.859287985" lastFinishedPulling="2026-05-27 18:36:11.585838304 +0000 UTC m=+20.236060881" observedRunningTime="2026-05-27 18:36:17.153341998 +0000 UTC m=+25.803564591" watchObservedRunningTime="2026-05-27 18:36:17.154896857 +0000 UTC m=+25.805119484"
May 27 18:36:17.981150 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:17.980986    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:17.981284 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:17.981256    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:18.104093 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.104016    2571 generic.go:358] "Generic (PLEG): container finished" podID="720134c5-5c97-4281-b0df-ddc63fef983b" containerID="20724ec540d296699e62364d181051bdb319e1e003b15913e93aba335a7feeba" exitCode=0
May 27 18:36:18.104464 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.104102    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerDied","Data":"20724ec540d296699e62364d181051bdb319e1e003b15913e93aba335a7feeba"}
May 27 18:36:18.104885 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.104866    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:36:18.104941 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.104899    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:36:18.104941 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.104913    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:36:18.120850 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.120825    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:36:18.120954 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.120888    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:36:18.273711 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.273683    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bjlvl"]
May 27 18:36:18.273854 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.273766    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:18.273854 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:18.273847    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:18.276923 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.276902    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pxq8"]
May 27 18:36:18.277041 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.276993    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:18.277118 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:18.277062    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:18.277488 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.277469    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6fb5"]
May 27 18:36:18.277594 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:18.277582    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:18.277714 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:18.277689    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:19.107560 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:19.107512    2571 generic.go:358] "Generic (PLEG): container finished" podID="720134c5-5c97-4281-b0df-ddc63fef983b" containerID="eb83603bb77add7f3bf2b9448b44b9f6d51fb9ee00ccccc4b312ceea31520110" exitCode=0
May 27 18:36:19.107942 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:19.107611    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerDied","Data":"eb83603bb77add7f3bf2b9448b44b9f6d51fb9ee00ccccc4b312ceea31520110"}
May 27 18:36:19.980908 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:19.980874    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:19.981069 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:19.980873    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:19.981069 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:19.980980    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:19.981069 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:19.980873    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:19.981243 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:19.981049    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:19.981243 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:19.981143    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:21.983349 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:21.983320    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:21.983811 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:21.983326    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:21.983811 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:21.983425    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:21.983811 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:21.983332    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:21.983811 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:21.983510    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:21.983811 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:21.983613    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:23.983273 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:23.983247    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:23.983663 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:23.983339    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjlvl" podUID="59104cfc-293e-409b-9366-bbd2b5b991c5"
May 27 18:36:23.983663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:23.983359    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:23.983663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:23.983382    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:23.983663 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:23.983444    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pxq8" podUID="86535f68-9c00-4a29-8e72-7ca2318a5bea"
May 27 18:36:23.983663 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:23.983509    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:36:24.199466 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.199315    2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeReady"
May 27 18:36:24.199614 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.199574    2571 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 18:36:24.233532 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.233445    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"]
May 27 18:36:24.262092 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.262064    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5897f96cdc-pcq4m"]
May 27 18:36:24.262224 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.262099    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.268494 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.265991    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 27 18:36:24.268494 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.266507    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 27 18:36:24.268494 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.266773    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 27 18:36:24.268494 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.267262    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 27 18:36:24.277927 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.277898    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"]
May 27 18:36:24.278132 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.278111    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.281867 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.281844    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fxcvz\""
May 27 18:36:24.281978 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.281854    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 18:36:24.281978 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.281931    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 18:36:24.281978 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.281881    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 18:36:24.286877 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.286855    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 18:36:24.300444 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.300425    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"]
May 27 18:36:24.300823 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.300803    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:24.304070 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.304048    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 27 18:36:24.304155 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.304122    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 27 18:36:24.304357 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.304342    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r4hb8\""
May 27 18:36:24.322341 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.322318    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"]
May 27 18:36:24.322429 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.322414    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.324926 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.324903    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 27 18:36:24.325004 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.324991    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2hs52\""
May 27 18:36:24.339052 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.339032    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5ncc7"]
May 27 18:36:24.339169 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.339155    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.341497 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.341479    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 27 18:36:24.341723 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.341709    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 27 18:36:24.341799 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.341716    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 27 18:36:24.345433 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.345414    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 27 18:36:24.357623 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.357602    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"]
May 27 18:36:24.357623 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.357632    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7t5z9"]
May 27 18:36:24.357777 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.357716    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.360055 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.360041    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 18:36:24.360116 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.360083    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 18:36:24.360116 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.360107    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s4chr\""
May 27 18:36:24.365537 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.365507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jmg\" (UniqueName: \"kubernetes.io/projected/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-kube-api-access-w5jmg\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.365596 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.365584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.365642 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.365630    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-tmp\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.378650 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378631    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"]
May 27 18:36:24.378737 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378657    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5897f96cdc-pcq4m"]
May 27 18:36:24.378737 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378669    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"]
May 27 18:36:24.378737 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378679    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"]
May 27 18:36:24.378869 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378759    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7t5z9"]
May 27 18:36:24.378869 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378772    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5ncc7"]
May 27 18:36:24.378869 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.378760    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:24.381256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.381241    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 18:36:24.381347 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.381242    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zv46l\""
May 27 18:36:24.381509 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.381494    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 18:36:24.381656 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.381551    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 18:36:24.465945 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.465920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71d7939d-6e88-4f72-8362-f9d3eccaa35a-config-volume\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.466065 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.465957    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-tmp\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.466065 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.465974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.466065 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.465995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmlv2\" (UniqueName: \"kubernetes.io/projected/71d7939d-6e88-4f72-8362-f9d3eccaa35a-kube-api-access-jmlv2\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.466065 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466025    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8976770f-c3d9-467c-84da-c3ef195a9979-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:24.466065 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.466221 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-image-registry-private-configuration\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466221 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/140c52f5-3164-49e2-bf71-d3bb398bfec0-ca-trust-extracted\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466221 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/def285f1-4b95-47f9-b381-b0bfe2af0307-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d5c86cc4-xw5js\" (UID: \"def285f1-4b95-47f9-b381-b0bfe2af0307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.466221 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466209    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jmg\" (UniqueName: \"kubernetes.io/projected/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-kube-api-access-w5jmg\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.466353 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466270    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.466353 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466318    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bmz\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-kube-api-access-k7bmz\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466413 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-certificates\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466413 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c62ql\" (UniqueName: \"kubernetes.io/projected/def285f1-4b95-47f9-b381-b0bfe2af0307-kube-api-access-c62ql\") pod \"managed-serviceaccount-addon-agent-76d5c86cc4-xw5js\" (UID: \"def285f1-4b95-47f9-b381-b0bfe2af0307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.466413 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466387    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-hub\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.466508 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466415    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.466508 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466597 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-trusted-ca\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466597 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466561    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-tmp\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.466597 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-ca\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.466679 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.466710 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466672    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvpb\" (UniqueName: \"kubernetes.io/projected/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-kube-api-access-hvvpb\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.466710 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-installation-pull-secrets\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466765 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71d7939d-6e88-4f72-8362-f9d3eccaa35a-tmp-dir\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.466765 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-bound-sa-token\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.466765 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.466741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:24.470536 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.470499    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.474241 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.474215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jmg\" (UniqueName: \"kubernetes.io/projected/059f44bf-3d0e-411d-bb2e-6dee3d6fe899-kube-api-access-w5jmg\") pod \"klusterlet-addon-workmgr-7cd7d6fb66-blssw\" (UID: \"059f44bf-3d0e-411d-bb2e-6dee3d6fe899\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.567818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.567788    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvpb\" (UniqueName: \"kubernetes.io/projected/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-kube-api-access-hvvpb\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.567818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.567821    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.568063 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.567858    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.568063 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.567996    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:24.568063 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568028    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-hub\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.568063 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568058    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568120    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568146    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568164    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568180    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:36:56.568162299 +0000 UTC m=+65.218384888 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568202    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-trusted-ca\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568212    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:25.068200376 +0000 UTC m=+33.718422966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:24.568256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568237    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-ca\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.568555 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568275    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-installation-pull-secrets\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.568555 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568466    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:24.568555 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568569    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568604    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568617    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568639    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/140c52f5-3164-49e2-bf71-d3bb398bfec0-ca-trust-extracted\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568645    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568670    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlv2\" (UniqueName: \"kubernetes.io/projected/71d7939d-6e88-4f72-8362-f9d3eccaa35a-kube-api-access-jmlv2\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.568703 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568685    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:25.068667013 +0000 UTC m=+33.718889589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568735    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bmz\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-kube-api-access-k7bmz\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.568746    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568765    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-certificates\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568794    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c62ql\" (UniqueName: \"kubernetes.io/projected/def285f1-4b95-47f9-b381-b0bfe2af0307-kube-api-access-c62ql\") pod \"managed-serviceaccount-addon-agent-76d5c86cc4-xw5js\" (UID: \"def285f1-4b95-47f9-b381-b0bfe2af0307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568823    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71d7939d-6e88-4f72-8362-f9d3eccaa35a-config-volume\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568879    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71d7939d-6e88-4f72-8362-f9d3eccaa35a-tmp-dir\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5jkm\" (UniqueName: \"kubernetes.io/projected/1df81cd4-4462-4c8d-a818-9975a78616d9-kube-api-access-j5jkm\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568947    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-bound-sa-token\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.568984    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8976770f-c3d9-467c-84da-c3ef195a9979-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:24.569039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.569016    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-image-registry-private-configuration\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.569528 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.569048    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/def285f1-4b95-47f9-b381-b0bfe2af0307-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d5c86cc4-xw5js\" (UID: \"def285f1-4b95-47f9-b381-b0bfe2af0307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.569528 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.569212    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-trusted-ca\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.569528 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.569307    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-certificates\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.569681 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.569588    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71d7939d-6e88-4f72-8362-f9d3eccaa35a-tmp-dir\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.569841 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.569821    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:36:25.069804431 +0000 UTC m=+33.720027007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:24.569961 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.569939    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/140c52f5-3164-49e2-bf71-d3bb398bfec0-ca-trust-extracted\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.570349 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.570327    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71d7939d-6e88-4f72-8362-f9d3eccaa35a-config-volume\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.570612 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.570590    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8976770f-c3d9-467c-84da-c3ef195a9979-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:24.571459 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.571431    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.571610 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.571587    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-installation-pull-secrets\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.571924 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.571900    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-hub\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.572602 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.572578    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.572682 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.572651    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/def285f1-4b95-47f9-b381-b0bfe2af0307-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d5c86cc4-xw5js\" (UID: \"def285f1-4b95-47f9-b381-b0bfe2af0307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.572799 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.572782    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-image-registry-private-configuration\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.572971 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.572952    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-ca\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.576366 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.576340    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvpb\" (UniqueName: \"kubernetes.io/projected/9eb2764a-c6e1-4ac8-b1a6-26586e23efeb-kube-api-access-hvvpb\") pod \"cluster-proxy-proxy-agent-66f74b67cb-gcwlv\" (UID: \"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.576468 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.576450    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlv2\" (UniqueName: \"kubernetes.io/projected/71d7939d-6e88-4f72-8362-f9d3eccaa35a-kube-api-access-jmlv2\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:24.577349 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.577335    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:24.580364 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.580321    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c62ql\" (UniqueName: \"kubernetes.io/projected/def285f1-4b95-47f9-b381-b0bfe2af0307-kube-api-access-c62ql\") pod \"managed-serviceaccount-addon-agent-76d5c86cc4-xw5js\" (UID: \"def285f1-4b95-47f9-b381-b0bfe2af0307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.582511 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.582489    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bmz\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-kube-api-access-k7bmz\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.595009 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.594988    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-bound-sa-token\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:24.646570 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.646533    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"
May 27 18:36:24.652499 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.652464    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.670457    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.670568    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.670648    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.670672    2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.670684    2571 projected.go:194] Error preparing data for projected volume kube-api-access-5drg5 for pod openshift-network-diagnostics/network-check-target-9pxq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.670743    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5 podName:86535f68-9c00-4a29-8e72-7ca2318a5bea nodeName:}" failed. No retries permitted until 2026-05-27 18:36:56.670725271 +0000 UTC m=+65.320947846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5drg5" (UniqueName: "kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5") pod "network-check-target-9pxq8" (UID: "86535f68-9c00-4a29-8e72-7ca2318a5bea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.670777    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:24.670826    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:25.170814474 +0000 UTC m=+33.821037061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:24.670948 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.670651    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5jkm\" (UniqueName: \"kubernetes.io/projected/1df81cd4-4462-4c8d-a818-9975a78616d9-kube-api-access-j5jkm\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:24.680084 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.680049    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5jkm\" (UniqueName: \"kubernetes.io/projected/1df81cd4-4462-4c8d-a818-9975a78616d9-kube-api-access-j5jkm\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:24.743115 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.743087    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"]
May 27 18:36:24.789265 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.789137    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js"]
May 27 18:36:24.791756 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:36:24.791730    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddef285f1_4b95_47f9_b381_b0bfe2af0307.slice/crio-c4a2e554c45738d641ab63704858dd43677f47bbd3a2f6732b9eeb9b6a2c568f WatchSource:0}: Error finding container c4a2e554c45738d641ab63704858dd43677f47bbd3a2f6732b9eeb9b6a2c568f: Status 404 returned error can't find the container with id c4a2e554c45738d641ab63704858dd43677f47bbd3a2f6732b9eeb9b6a2c568f
May 27 18:36:24.795781 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:24.795757    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"]
May 27 18:36:24.798455 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:36:24.798435    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eb2764a_c6e1_4ac8_b1a6_26586e23efeb.slice/crio-d79b73478b7751384fada2107e834637777b23b949f1327647262ddaa0c9ffcc WatchSource:0}: Error finding container d79b73478b7751384fada2107e834637777b23b949f1327647262ddaa0c9ffcc: Status 404 returned error can't find the container with id d79b73478b7751384fada2107e834637777b23b949f1327647262ddaa0c9ffcc
May 27 18:36:25.074732 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.074703    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.074743    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.074780    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074853    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074872    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074898    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074909    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074929    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:26.074907566 +0000 UTC m=+34.725130160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074947    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:36:26.07493793 +0000 UTC m=+34.725160511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:25.075440 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.074964    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:26.074956399 +0000 UTC m=+34.725178975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:25.118689 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.118659    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" event={"ID":"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb","Type":"ContainerStarted","Data":"d79b73478b7751384fada2107e834637777b23b949f1327647262ddaa0c9ffcc"}
May 27 18:36:25.119908 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.119846    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js" event={"ID":"def285f1-4b95-47f9-b381-b0bfe2af0307","Type":"ContainerStarted","Data":"c4a2e554c45738d641ab63704858dd43677f47bbd3a2f6732b9eeb9b6a2c568f"}
May 27 18:36:25.120946 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.120924    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw" event={"ID":"059f44bf-3d0e-411d-bb2e-6dee3d6fe899","Type":"ContainerStarted","Data":"99685c28d78ed5dc53279387dd5f00cea2b39fed035cecf79b561af67f186e75"}
May 27 18:36:25.175854 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.175821    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:25.175988 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.175971    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:25.176036 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:25.176027    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:26.176012964 +0000 UTC m=+34.826235538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:25.987818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.986681    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:25.987818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.987104    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:25.987818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.987418    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:25.992870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.991571    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 18:36:25.992870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.991830    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9wtn\""
May 27 18:36:25.992870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.992085    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 18:36:25.992870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.992299    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 18:36:25.992870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.992480    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zr9kw\""
May 27 18:36:25.992870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:25.992683    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 18:36:26.083699 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:26.083650    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:26.084272 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:26.083707    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:26.084272 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:26.083747    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:26.084272 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.083867    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:26.084272 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.084168    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:36:28.084140711 +0000 UTC m=+36.734363289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:26.084578 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.084008    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:26.084578 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.084499    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:26.084578 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.084558    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:28.084544004 +0000 UTC m=+36.734766584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:26.084578 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.084061    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:26.084786 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.084606    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:28.084595119 +0000 UTC m=+36.734817695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:26.184532 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:26.184491    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:26.184744 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.184644    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:26.184744 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:26.184717    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:28.184697531 +0000 UTC m=+36.834920109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:28.104625    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.104893    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.104918    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.104983    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:32.104960899 +0000 UTC m=+40.755183481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.104986    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:28.104898    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:28.105075 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.105047    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:32.105032156 +0000 UTC m=+40.755254733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:28.105757 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:28.105089    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:28.105757 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.105208    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:28.105757 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.105251    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:36:32.105235604 +0000 UTC m=+40.755458182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:28.205740 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:28.205564    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:28.206403 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.206018    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:28.206629 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:28.206606    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:32.20658209 +0000 UTC m=+40.856804669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:29.821242 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:29.821207    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:29.824446 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:29.824425    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59104cfc-293e-409b-9366-bbd2b5b991c5-original-pull-secret\") pod \"global-pull-secret-syncer-bjlvl\" (UID: \"59104cfc-293e-409b-9366-bbd2b5b991c5\") " pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:29.917044 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:29.917006    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjlvl"
May 27 18:36:32.139195 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:32.139156    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:32.139195 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:32.139210    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:32.139282    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139318    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139369    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:40.139352781 +0000 UTC m=+48.789575354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139428    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139490    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:36:40.139474652 +0000 UTC m=+48.789697232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139431    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139513    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:32.139724 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.139564    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:40.139553073 +0000 UTC m=+48.789775653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:32.240005 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:32.239970    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:32.240159 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.240092    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:32.240159 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:32.240153    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:40.240135469 +0000 UTC m=+48.890358049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:35.054964 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.054937    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bjlvl"]
May 27 18:36:35.057989 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:36:35.057956    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59104cfc_293e_409b_9366_bbd2b5b991c5.slice/crio-5015f1cc964d1d4f36c2addee26699b032d7c93c5fe32be6b58542a6a5625ef0 WatchSource:0}: Error finding container 5015f1cc964d1d4f36c2addee26699b032d7c93c5fe32be6b58542a6a5625ef0: Status 404 returned error can't find the container with id 5015f1cc964d1d4f36c2addee26699b032d7c93c5fe32be6b58542a6a5625ef0
May 27 18:36:35.143278 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.143141    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js" event={"ID":"def285f1-4b95-47f9-b381-b0bfe2af0307","Type":"ContainerStarted","Data":"0a08d53e1e12cdbdfd698478f311296630592caa7ccd30cddc703570744123a8"}
May 27 18:36:35.144138 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.144114    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bjlvl" event={"ID":"59104cfc-293e-409b-9366-bbd2b5b991c5","Type":"ContainerStarted","Data":"5015f1cc964d1d4f36c2addee26699b032d7c93c5fe32be6b58542a6a5625ef0"}
May 27 18:36:35.146546 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.146503    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerStarted","Data":"34dee6759344ee63c58489b1e6ee00e47a50bf76293c200f4b7b0979b05910cf"}
May 27 18:36:35.151505 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.151456    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" event={"ID":"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb","Type":"ContainerStarted","Data":"788c878783efaaabd7411a85e4b528e8dacbd193194dc6acbfd5961bdc132e75"}
May 27 18:36:35.153169 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.153148    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw" event={"ID":"059f44bf-3d0e-411d-bb2e-6dee3d6fe899","Type":"ContainerStarted","Data":"7e7dbc7852d320e083f80d8bab3dd441619d805b1a4013b7cdc7d422c8c3bac2"}
May 27 18:36:35.153591 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.153564    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:35.154891 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.154861    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:36:35.158927 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.158893    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js" podStartSLOduration=27.033284667 podStartE2EDuration="37.158884075s" podCreationTimestamp="2026-05-27 18:35:58 +0000 UTC" firstStartedPulling="2026-05-27 18:36:24.793583985 +0000 UTC m=+33.443806560" lastFinishedPulling="2026-05-27 18:36:34.919183386 +0000 UTC m=+43.569405968" observedRunningTime="2026-05-27 18:36:35.158563463 +0000 UTC m=+43.808786059" watchObservedRunningTime="2026-05-27 18:36:35.158884075 +0000 UTC m=+43.809106673"
May 27 18:36:35.197224 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:35.197177    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw" podStartSLOduration=27.012414641 podStartE2EDuration="37.197162081s" podCreationTimestamp="2026-05-27 18:35:58 +0000 UTC" firstStartedPulling="2026-05-27 18:36:24.752266215 +0000 UTC m=+33.402488789" lastFinishedPulling="2026-05-27 18:36:34.937013655 +0000 UTC m=+43.587236229" observedRunningTime="2026-05-27 18:36:35.196498456 +0000 UTC m=+43.846721055" watchObservedRunningTime="2026-05-27 18:36:35.197162081 +0000 UTC m=+43.847384677"
May 27 18:36:36.158868 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:36.158814    2571 generic.go:358] "Generic (PLEG): container finished" podID="720134c5-5c97-4281-b0df-ddc63fef983b" containerID="34dee6759344ee63c58489b1e6ee00e47a50bf76293c200f4b7b0979b05910cf" exitCode=0
May 27 18:36:36.159725 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:36.159626    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerDied","Data":"34dee6759344ee63c58489b1e6ee00e47a50bf76293c200f4b7b0979b05910cf"}
May 27 18:36:37.164534 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:37.164478    2571 generic.go:358] "Generic (PLEG): container finished" podID="720134c5-5c97-4281-b0df-ddc63fef983b" containerID="d7a143ee63ba1fabd370c67e69cfae0759e97d2fa9d5426bb90f0365212668d9" exitCode=0
May 27 18:36:37.164940 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:37.164626    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerDied","Data":"d7a143ee63ba1fabd370c67e69cfae0759e97d2fa9d5426bb90f0365212668d9"}
May 27 18:36:38.169256 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:38.169219    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqr27" event={"ID":"720134c5-5c97-4281-b0df-ddc63fef983b","Type":"ContainerStarted","Data":"d2a7f89b274290ecff28413ff3531dcfed0a83cc27138e2f89cc5cf9acf01a9f"}
May 27 18:36:38.171096 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:38.171066    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" event={"ID":"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb","Type":"ContainerStarted","Data":"60d70900db435e239809e2e4b0d0246eb2061ce79e9fad79cb3d2af1b69f4a26"}
May 27 18:36:38.171096 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:38.171100    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" event={"ID":"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb","Type":"ContainerStarted","Data":"48a8c932ea193fc51553cf46b78e7b0794e47bb8c35678ecda2cd65aa52a7eab"}
May 27 18:36:38.192431 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:38.192386    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jqr27" podStartSLOduration=4.3977351 podStartE2EDuration="46.192369971s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="2026-05-27 18:35:53.12332149 +0000 UTC m=+1.773544066" lastFinishedPulling="2026-05-27 18:36:34.91795636 +0000 UTC m=+43.568178937" observedRunningTime="2026-05-27 18:36:38.190565113 +0000 UTC m=+46.840787711" watchObservedRunningTime="2026-05-27 18:36:38.192369971 +0000 UTC m=+46.842592569"
May 27 18:36:38.208595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:38.208543    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" podStartSLOduration=27.30731315 podStartE2EDuration="40.208506594s" podCreationTimestamp="2026-05-27 18:35:58 +0000 UTC" firstStartedPulling="2026-05-27 18:36:24.800145691 +0000 UTC m=+33.450368265" lastFinishedPulling="2026-05-27 18:36:37.70133913 +0000 UTC m=+46.351561709" observedRunningTime="2026-05-27 18:36:38.207912616 +0000 UTC m=+46.858135227" watchObservedRunningTime="2026-05-27 18:36:38.208506594 +0000 UTC m=+46.858729167"
May 27 18:36:40.176539 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:40.176446    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bjlvl" event={"ID":"59104cfc-293e-409b-9366-bbd2b5b991c5","Type":"ContainerStarted","Data":"96c1fd976ba6ef6116defc5ea1df6bf1076e4c5dd4f8d6c0f12d6d10883f8e5d"}
May 27 18:36:40.192886 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:40.192840    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bjlvl" podStartSLOduration=38.428570519 podStartE2EDuration="43.192827815s" podCreationTimestamp="2026-05-27 18:35:57 +0000 UTC" firstStartedPulling="2026-05-27 18:36:35.059707096 +0000 UTC m=+43.709929672" lastFinishedPulling="2026-05-27 18:36:39.823964383 +0000 UTC m=+48.474186968" observedRunningTime="2026-05-27 18:36:40.192202642 +0000 UTC m=+48.842425240" watchObservedRunningTime="2026-05-27 18:36:40.192827815 +0000 UTC m=+48.843050402"
May 27 18:36:40.209546 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:40.209502    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:40.209604 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:40.209566    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:40.209604 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:40.209595    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:40.209671 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209637    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:40.209671 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209654    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:40.209738 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209700    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:40.209775 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209701    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:40.209775 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209706    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:56.20969315 +0000 UTC m=+64.859915725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:40.209847 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209777    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:56.209765105 +0000 UTC m=+64.859987679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:40.209847 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.209790    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:36:56.209783764 +0000 UTC m=+64.860006337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:40.310677 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:40.310645    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:40.310820 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.310769    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:40.310890 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:40.310848    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:36:56.310828162 +0000 UTC m=+64.961050740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:50.120559 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:50.120504    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzrfx"
May 27 18:36:56.236238 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.236198    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.236247    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.236283    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236331    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236348    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236394    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236394    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236399    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:28.23638375 +0000 UTC m=+96.886606323 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236472    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:37:28.236456572 +0000 UTC m=+96.886679153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:36:56.236712 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.236495    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:28.236485644 +0000 UTC m=+96.886708224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:36:56.336612 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.336576    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:36:56.336841 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.336733    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:36:56.336841 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.336807    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:37:28.336790196 +0000 UTC m=+96.987012773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:36:56.638920 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.638886    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:36:56.641578 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.641561    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 18:36:56.649844 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.649826    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 18:36:56.649908 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:36:56.649878    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:38:00.649864019 +0000 UTC m=+129.300086592 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : secret "metrics-daemon-secret" not found
May 27 18:36:56.740093 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.740046    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:56.743009 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.742989    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 18:36:56.752882 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.752862    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 18:36:56.763627 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.763598    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5drg5\" (UniqueName: \"kubernetes.io/projected/86535f68-9c00-4a29-8e72-7ca2318a5bea-kube-api-access-5drg5\") pod \"network-check-target-9pxq8\" (UID: \"86535f68-9c00-4a29-8e72-7ca2318a5bea\") " pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:56.909556 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.909450    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9wtn\""
May 27 18:36:56.917676 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:56.917657    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:36:57.037818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:57.037778    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pxq8"]
May 27 18:36:57.040831 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:36:57.040803    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86535f68_9c00_4a29_8e72_7ca2318a5bea.slice/crio-1971c969e8730a9ba269486850c27c5caf9122a03be9a537b39d156991bc7a14 WatchSource:0}: Error finding container 1971c969e8730a9ba269486850c27c5caf9122a03be9a537b39d156991bc7a14: Status 404 returned error can't find the container with id 1971c969e8730a9ba269486850c27c5caf9122a03be9a537b39d156991bc7a14
May 27 18:36:57.211121 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:36:57.211040    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pxq8" event={"ID":"86535f68-9c00-4a29-8e72-7ca2318a5bea","Type":"ContainerStarted","Data":"1971c969e8730a9ba269486850c27c5caf9122a03be9a537b39d156991bc7a14"}
May 27 18:37:00.219734 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:00.219697    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pxq8" event={"ID":"86535f68-9c00-4a29-8e72-7ca2318a5bea","Type":"ContainerStarted","Data":"c687f23896a405a4f78d2f0d84c2f9ecf53cb034b1293183766bf172e1949c34"}
May 27 18:37:00.220126 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:00.219845    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:37:00.236147 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:00.236104    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9pxq8" podStartSLOduration=66.696749349 podStartE2EDuration="1m9.236091917s" podCreationTimestamp="2026-05-27 18:35:51 +0000 UTC" firstStartedPulling="2026-05-27 18:36:57.043010586 +0000 UTC m=+65.693233159" lastFinishedPulling="2026-05-27 18:36:59.58235315 +0000 UTC m=+68.232575727" observedRunningTime="2026-05-27 18:37:00.234487619 +0000 UTC m=+68.884710216" watchObservedRunningTime="2026-05-27 18:37:00.236091917 +0000 UTC m=+68.886314512"
May 27 18:37:28.284967 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:28.284934    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:28.284980    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:28.285027    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285082    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285102    2571 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285112    2571 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5897f96cdc-pcq4m: secret "image-registry-tls" not found
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285136    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285158    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:32.285136458 +0000 UTC m=+160.935359035 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285180    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls podName:140c52f5-3164-49e2-bf71-d3bb398bfec0 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:32.285170569 +0000 UTC m=+160.935393142 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls") pod "image-registry-5897f96cdc-pcq4m" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0") : secret "image-registry-tls" not found
May 27 18:37:28.285385 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.285192    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls podName:71d7939d-6e88-4f72-8362-f9d3eccaa35a nodeName:}" failed. No retries permitted until 2026-05-27 18:38:32.285187042 +0000 UTC m=+160.935409616 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls") pod "dns-default-5ncc7" (UID: "71d7939d-6e88-4f72-8362-f9d3eccaa35a") : secret "dns-default-metrics-tls" not found
May 27 18:37:28.385699 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:28.385658    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:37:28.385855 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.385810    2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 18:37:28.385898 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:37:28.385872    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert podName:1df81cd4-4462-4c8d-a818-9975a78616d9 nodeName:}" failed. No retries permitted until 2026-05-27 18:38:32.385856594 +0000 UTC m=+161.036079168 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert") pod "ingress-canary-7t5z9" (UID: "1df81cd4-4462-4c8d-a818-9975a78616d9") : secret "canary-serving-cert" not found
May 27 18:37:31.224743 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:37:31.224709    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9pxq8"
May 27 18:38:00.739044 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:00.739001    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:38:00.739554 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:00.739150    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 18:38:00.739554 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:00.739219    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs podName:3d7fbf16-8394-4c75-ac14-50fae454a40b nodeName:}" failed. No retries permitted until 2026-05-27 18:40:02.739202381 +0000 UTC m=+251.389424955 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs") pod "network-metrics-daemon-q6fb5" (UID: "3d7fbf16-8394-4c75-ac14-50fae454a40b") : secret "metrics-daemon-secret" not found
May 27 18:38:20.156430 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:20.156400    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grtqd_4edbe929-ca0b-4043-ac0e-76cdbf902714/dns-node-resolver/0.log"
May 27 18:38:21.155462 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:21.155432    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2lngs_d94df2f4-b39d-4f3c-a26d-8f99aeba0382/node-ca/0.log"
May 27 18:38:27.287749 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:27.287704    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0"
May 27 18:38:27.309808 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:27.309783    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs" podUID="8976770f-c3d9-467c-84da-c3ef195a9979"
May 27 18:38:27.373760 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:27.373719    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5ncc7" podUID="71d7939d-6e88-4f72-8362-f9d3eccaa35a"
May 27 18:38:27.385865 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:27.385841    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7t5z9" podUID="1df81cd4-4462-4c8d-a818-9975a78616d9"
May 27 18:38:27.419617 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:27.419590    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:38:27.419722 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:27.419590    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5ncc7"
May 27 18:38:27.419770 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:27.419597    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:38:27.419850 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:27.419597    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:38:29.024765 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:29.024719    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q6fb5" podUID="3d7fbf16-8394-4c75-ac14-50fae454a40b"
May 27 18:38:32.382371 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.382329    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:38:32.382371 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.382376    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:38:32.382817 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.382429    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:38:32.382817 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:32.382510    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 18:38:32.382817 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:38:32.382627    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert podName:8976770f-c3d9-467c-84da-c3ef195a9979 nodeName:}" failed. No retries permitted until 2026-05-27 18:40:34.382604938 +0000 UTC m=+283.032827517 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-kpdqs" (UID: "8976770f-c3d9-467c-84da-c3ef195a9979") : secret "networking-console-plugin-cert" not found
May 27 18:38:32.384800 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.384767    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71d7939d-6e88-4f72-8362-f9d3eccaa35a-metrics-tls\") pod \"dns-default-5ncc7\" (UID: \"71d7939d-6e88-4f72-8362-f9d3eccaa35a\") " pod="openshift-dns/dns-default-5ncc7"
May 27 18:38:32.384921 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.384828    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"image-registry-5897f96cdc-pcq4m\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") " pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:38:32.482850 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.482817    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:38:32.485240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.485218    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1df81cd4-4462-4c8d-a818-9975a78616d9-cert\") pod \"ingress-canary-7t5z9\" (UID: \"1df81cd4-4462-4c8d-a818-9975a78616d9\") " pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:38:32.524675 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.524649    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fxcvz\""
May 27 18:38:32.524675 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.524661    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zv46l\""
May 27 18:38:32.524675 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.524657    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s4chr\""
May 27 18:38:32.531006 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.530986    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7t5z9"
May 27 18:38:32.531068 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.531013    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5ncc7"
May 27 18:38:32.531118 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.531103    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:38:32.671365 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.671324    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7t5z9"]
May 27 18:38:32.674854 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:38:32.674828    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df81cd4_4462_4c8d_a818_9975a78616d9.slice/crio-6107dc863b22963408853ad4e5534fec2dadf12ee4a335761ef5782cefd3010f WatchSource:0}: Error finding container 6107dc863b22963408853ad4e5534fec2dadf12ee4a335761ef5782cefd3010f: Status 404 returned error can't find the container with id 6107dc863b22963408853ad4e5534fec2dadf12ee4a335761ef5782cefd3010f
May 27 18:38:32.894160 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.894090    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5ncc7"]
May 27 18:38:32.897306 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:38:32.897272    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d7939d_6e88_4f72_8362_f9d3eccaa35a.slice/crio-ada7a41aa5718c27751cc5d023a2d2409a1257001388382c1f0820b9921f405d WatchSource:0}: Error finding container ada7a41aa5718c27751cc5d023a2d2409a1257001388382c1f0820b9921f405d: Status 404 returned error can't find the container with id ada7a41aa5718c27751cc5d023a2d2409a1257001388382c1f0820b9921f405d
May 27 18:38:32.897564 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:32.897545    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5897f96cdc-pcq4m"]
May 27 18:38:32.900528 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:38:32.900492    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140c52f5_3164_49e2_bf71_d3bb398bfec0.slice/crio-d0d6a72545622c4d2385e2de116f18172f48e48446dbc95e119e933ad46c4288 WatchSource:0}: Error finding container d0d6a72545622c4d2385e2de116f18172f48e48446dbc95e119e933ad46c4288: Status 404 returned error can't find the container with id d0d6a72545622c4d2385e2de116f18172f48e48446dbc95e119e933ad46c4288
May 27 18:38:33.436477 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:33.436374    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" event={"ID":"140c52f5-3164-49e2-bf71-d3bb398bfec0","Type":"ContainerStarted","Data":"d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652"}
May 27 18:38:33.436477 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:33.436419    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" event={"ID":"140c52f5-3164-49e2-bf71-d3bb398bfec0","Type":"ContainerStarted","Data":"d0d6a72545622c4d2385e2de116f18172f48e48446dbc95e119e933ad46c4288"}
May 27 18:38:33.436477 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:33.436439    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:38:33.438602 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:33.438541    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7t5z9" event={"ID":"1df81cd4-4462-4c8d-a818-9975a78616d9","Type":"ContainerStarted","Data":"6107dc863b22963408853ad4e5534fec2dadf12ee4a335761ef5782cefd3010f"}
May 27 18:38:33.441892 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:33.441861    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5ncc7" event={"ID":"71d7939d-6e88-4f72-8362-f9d3eccaa35a","Type":"ContainerStarted","Data":"ada7a41aa5718c27751cc5d023a2d2409a1257001388382c1f0820b9921f405d"}
May 27 18:38:33.458375 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:33.458316    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" podStartSLOduration=161.458297177 podStartE2EDuration="2m41.458297177s" podCreationTimestamp="2026-05-27 18:35:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:38:33.457031024 +0000 UTC m=+162.107253633" watchObservedRunningTime="2026-05-27 18:38:33.458297177 +0000 UTC m=+162.108519775"
May 27 18:38:35.154860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.154815    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw" podUID="059f44bf-3d0e-411d-bb2e-6dee3d6fe899" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/readyz\": dial tcp 10.132.0.6:8000: connect: connection refused"
May 27 18:38:35.450202 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.450107    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7t5z9" event={"ID":"1df81cd4-4462-4c8d-a818-9975a78616d9","Type":"ContainerStarted","Data":"16deb05c272435a07ab5b181cee474b7d00dd7bc534d20448cda865b7e3d6823"}
May 27 18:38:35.451338 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.451315    2571 generic.go:358] "Generic (PLEG): container finished" podID="def285f1-4b95-47f9-b381-b0bfe2af0307" containerID="0a08d53e1e12cdbdfd698478f311296630592caa7ccd30cddc703570744123a8" exitCode=255
May 27 18:38:35.451461 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.451375    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js" event={"ID":"def285f1-4b95-47f9-b381-b0bfe2af0307","Type":"ContainerDied","Data":"0a08d53e1e12cdbdfd698478f311296630592caa7ccd30cddc703570744123a8"}
May 27 18:38:35.451677 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.451660    2571 scope.go:117] "RemoveContainer" containerID="0a08d53e1e12cdbdfd698478f311296630592caa7ccd30cddc703570744123a8"
May 27 18:38:35.452938 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.452913    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5ncc7" event={"ID":"71d7939d-6e88-4f72-8362-f9d3eccaa35a","Type":"ContainerStarted","Data":"85294c4a41bc2867838fdd0c07c7bb3df78e864557c6abd7901388d8c1c668bd"}
May 27 18:38:35.452938 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.452944    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5ncc7" event={"ID":"71d7939d-6e88-4f72-8362-f9d3eccaa35a","Type":"ContainerStarted","Data":"59d4c1386e10ce8d22008b7aa90532a29318969861422d5aa83a476e27c9fd16"}
May 27 18:38:35.453076 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.452979    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5ncc7"
May 27 18:38:35.454207 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.454188    2571 generic.go:358] "Generic (PLEG): container finished" podID="059f44bf-3d0e-411d-bb2e-6dee3d6fe899" containerID="7e7dbc7852d320e083f80d8bab3dd441619d805b1a4013b7cdc7d422c8c3bac2" exitCode=1
May 27 18:38:35.454298 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.454238    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw" event={"ID":"059f44bf-3d0e-411d-bb2e-6dee3d6fe899","Type":"ContainerDied","Data":"7e7dbc7852d320e083f80d8bab3dd441619d805b1a4013b7cdc7d422c8c3bac2"}
May 27 18:38:35.454548 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.454534    2571 scope.go:117] "RemoveContainer" containerID="7e7dbc7852d320e083f80d8bab3dd441619d805b1a4013b7cdc7d422c8c3bac2"
May 27 18:38:35.467780 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.467606    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7t5z9" podStartSLOduration=129.360185871 podStartE2EDuration="2m11.467590457s" podCreationTimestamp="2026-05-27 18:36:24 +0000 UTC" firstStartedPulling="2026-05-27 18:38:32.676503123 +0000 UTC m=+161.326725696" lastFinishedPulling="2026-05-27 18:38:34.783907707 +0000 UTC m=+163.434130282" observedRunningTime="2026-05-27 18:38:35.467427168 +0000 UTC m=+164.117649763" watchObservedRunningTime="2026-05-27 18:38:35.467590457 +0000 UTC m=+164.117813050"
May 27 18:38:35.488942 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:35.488894    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-5ncc7" podStartSLOduration=129.604971101 podStartE2EDuration="2m11.488879038s" podCreationTimestamp="2026-05-27 18:36:24 +0000 UTC" firstStartedPulling="2026-05-27 18:38:32.899436301 +0000 UTC m=+161.549658875" lastFinishedPulling="2026-05-27 18:38:34.783344235 +0000 UTC m=+163.433566812" observedRunningTime="2026-05-27 18:38:35.488036291 +0000 UTC m=+164.138258886" watchObservedRunningTime="2026-05-27 18:38:35.488879038 +0000 UTC m=+164.139101634"
May 27 18:38:36.458126 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:36.458091    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw" event={"ID":"059f44bf-3d0e-411d-bb2e-6dee3d6fe899","Type":"ContainerStarted","Data":"fd5da5d2baf0c23e1c58b305f2780d119202999c18ed42ee259189fc0469ff00"}
May 27 18:38:36.458618 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:36.458381    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:38:36.459104 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:36.459078    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cd7d6fb66-blssw"
May 27 18:38:36.459787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:36.459760    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d5c86cc4-xw5js" event={"ID":"def285f1-4b95-47f9-b381-b0bfe2af0307","Type":"ContainerStarted","Data":"606aa24eb882ea99e535392505d992d600fc53b629f6b4df5efcb5db34d28693"}
May 27 18:38:41.983479 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:41.983397    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:38:42.236909 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.236823    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vsc57"]
May 27 18:38:42.239410 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.239387    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.242234 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.242211    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z6wdj\""
May 27 18:38:42.242961 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.242939    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 18:38:42.243069 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.242978    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 18:38:42.243069 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.242992    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 18:38:42.243258 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.243243    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 18:38:42.249307 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.249288    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vsc57"]
May 27 18:38:42.260179 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.260159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88ba61a2-4051-4b37-854d-ecc40960308b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.260268 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.260196    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ba61a2-4051-4b37-854d-ecc40960308b-data-volume\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.260268 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.260213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88ba61a2-4051-4b37-854d-ecc40960308b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.260268 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.260240    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9pb\" (UniqueName: \"kubernetes.io/projected/88ba61a2-4051-4b37-854d-ecc40960308b-kube-api-access-lc9pb\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.260367 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.260314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88ba61a2-4051-4b37-854d-ecc40960308b-crio-socket\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.361633 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.361597    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88ba61a2-4051-4b37-854d-ecc40960308b-crio-socket\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.361791 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.361666    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88ba61a2-4051-4b37-854d-ecc40960308b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.361791 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.361713    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ba61a2-4051-4b37-854d-ecc40960308b-data-volume\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.361791 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.361720    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88ba61a2-4051-4b37-854d-ecc40960308b-crio-socket\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.361791 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.361742    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88ba61a2-4051-4b37-854d-ecc40960308b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.361791 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.361772    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9pb\" (UniqueName: \"kubernetes.io/projected/88ba61a2-4051-4b37-854d-ecc40960308b-kube-api-access-lc9pb\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.362042 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.362023    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88ba61a2-4051-4b37-854d-ecc40960308b-data-volume\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.362332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.362307    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88ba61a2-4051-4b37-854d-ecc40960308b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.363946 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.363928    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88ba61a2-4051-4b37-854d-ecc40960308b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.371420 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.371396    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9pb\" (UniqueName: \"kubernetes.io/projected/88ba61a2-4051-4b37-854d-ecc40960308b-kube-api-access-lc9pb\") pod \"insights-runtime-extractor-vsc57\" (UID: \"88ba61a2-4051-4b37-854d-ecc40960308b\") " pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.549453 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.549411    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vsc57"
May 27 18:38:42.668995 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:42.668965    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vsc57"]
May 27 18:38:42.671993 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:38:42.671959    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ba61a2_4051_4b37_854d_ecc40960308b.slice/crio-6343e2b92a0a14c4a731ec63f5d3696620e1ef8da8f2b3947d2c7fbc4e591492 WatchSource:0}: Error finding container 6343e2b92a0a14c4a731ec63f5d3696620e1ef8da8f2b3947d2c7fbc4e591492: Status 404 returned error can't find the container with id 6343e2b92a0a14c4a731ec63f5d3696620e1ef8da8f2b3947d2c7fbc4e591492
May 27 18:38:43.480983 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:43.480952    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsc57" event={"ID":"88ba61a2-4051-4b37-854d-ecc40960308b","Type":"ContainerStarted","Data":"2253359dad36ba427d242221d2be7fe0f5bcf10c15e910dabe19d3305f0b293d"}
May 27 18:38:43.480983 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:43.480990    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsc57" event={"ID":"88ba61a2-4051-4b37-854d-ecc40960308b","Type":"ContainerStarted","Data":"40d4eba1089e236fd2ff39563bbad30258ef8a06e81c10c7ea08f63520e6810d"}
May 27 18:38:43.481364 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:43.481001    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsc57" event={"ID":"88ba61a2-4051-4b37-854d-ecc40960308b","Type":"ContainerStarted","Data":"6343e2b92a0a14c4a731ec63f5d3696620e1ef8da8f2b3947d2c7fbc4e591492"}
May 27 18:38:45.462436 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:45.462352    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5ncc7"
May 27 18:38:45.491437 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:45.491400    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsc57" event={"ID":"88ba61a2-4051-4b37-854d-ecc40960308b","Type":"ContainerStarted","Data":"ff92d5ceb1bab6f8c7bf01dd428772d642cea684a241fb90bc0243a217063ea2"}
May 27 18:38:45.509121 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:45.509071    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vsc57" podStartSLOduration=1.196144896 podStartE2EDuration="3.509057361s" podCreationTimestamp="2026-05-27 18:38:42 +0000 UTC" firstStartedPulling="2026-05-27 18:38:42.723086682 +0000 UTC m=+171.373309256" lastFinishedPulling="2026-05-27 18:38:45.035999136 +0000 UTC m=+173.686221721" observedRunningTime="2026-05-27 18:38:45.508413042 +0000 UTC m=+174.158635651" watchObservedRunningTime="2026-05-27 18:38:45.509057361 +0000 UTC m=+174.159279956"
May 27 18:38:52.535439 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:52.535389    2571 patch_prober.go:28] interesting pod/image-registry-5897f96cdc-pcq4m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 18:38:52.535898 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:52.535465    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 18:38:54.449859 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:54.449827    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:38:54.654453 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:38:54.654412    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" podUID="9eb2764a-c6e1-4ac8-b1a6-26586e23efeb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 18:39:03.916551 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:03.916501    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5897f96cdc-pcq4m"]
May 27 18:39:04.653650 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:04.653582    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" podUID="9eb2764a-c6e1-4ac8-b1a6-26586e23efeb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 18:39:06.500966 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.500927    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-26zf4"]
May 27 18:39:06.504261 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.504239    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.507023 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.507001    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 18:39:06.507156 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.507059    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 18:39:06.507223 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.507170    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 18:39:06.507309 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.507293    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 18:39:06.508147 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.508128    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 18:39:06.508147 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.508137    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kf6kq\""
May 27 18:39:06.508279 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.508150    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 18:39:06.660956 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.660926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f997m\" (UniqueName: \"kubernetes.io/projected/881d0167-3d13-4db8-b4ea-7d968140adf7-kube-api-access-f997m\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.660956 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.660959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-sys\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-root\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661053    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-tls\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/881d0167-3d13-4db8-b4ea-7d968140adf7-metrics-client-ca\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-wtmp\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-textfile\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.661354 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.661216    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761558    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761606    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f997m\" (UniqueName: \"kubernetes.io/projected/881d0167-3d13-4db8-b4ea-7d968140adf7-kube-api-access-f997m\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761628    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-sys\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761674    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761693    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-root\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761751    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-sys\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761821    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-tls\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761842    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-root\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761881    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/881d0167-3d13-4db8-b4ea-7d968140adf7-metrics-client-ca\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.761929 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761924    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-wtmp\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.762236 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:39:06.761932    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 27 18:39:06.762236 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.761955    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-textfile\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.762236 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:39:06.762005    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-tls podName:881d0167-3d13-4db8-b4ea-7d968140adf7 nodeName:}" failed. No retries permitted until 2026-05-27 18:39:07.261983743 +0000 UTC m=+195.912206321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-tls") pod "node-exporter-26zf4" (UID: "881d0167-3d13-4db8-b4ea-7d968140adf7") : secret "node-exporter-tls" not found
May 27 18:39:06.762236 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.762100    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-wtmp\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.762236 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.762199    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.762236 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.762215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-textfile\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.762440 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.762378    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/881d0167-3d13-4db8-b4ea-7d968140adf7-metrics-client-ca\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.764036 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.764010    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:06.770813 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:06.770792    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f997m\" (UniqueName: \"kubernetes.io/projected/881d0167-3d13-4db8-b4ea-7d968140adf7-kube-api-access-f997m\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:07.265806 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:07.265770    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-tls\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:07.268128 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:07.268109    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/881d0167-3d13-4db8-b4ea-7d968140adf7-node-exporter-tls\") pod \"node-exporter-26zf4\" (UID: \"881d0167-3d13-4db8-b4ea-7d968140adf7\") " pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:07.413247 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:07.413218    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-26zf4"
May 27 18:39:07.423308 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:39:07.423272    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881d0167_3d13_4db8_b4ea_7d968140adf7.slice/crio-2fb6bd34e6a65fbc190ab0d634063307e769784848561a1fab7c7cc7ec2b4984 WatchSource:0}: Error finding container 2fb6bd34e6a65fbc190ab0d634063307e769784848561a1fab7c7cc7ec2b4984: Status 404 returned error can't find the container with id 2fb6bd34e6a65fbc190ab0d634063307e769784848561a1fab7c7cc7ec2b4984
May 27 18:39:07.547691 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:07.547603    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26zf4" event={"ID":"881d0167-3d13-4db8-b4ea-7d968140adf7","Type":"ContainerStarted","Data":"2fb6bd34e6a65fbc190ab0d634063307e769784848561a1fab7c7cc7ec2b4984"}
May 27 18:39:08.555151 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:08.555061    2571 generic.go:358] "Generic (PLEG): container finished" podID="881d0167-3d13-4db8-b4ea-7d968140adf7" containerID="c5253449b11277d17740c08125970911ef6a375181e5b66db914cfadc938dae0" exitCode=0
May 27 18:39:08.555151 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:08.555103    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26zf4" event={"ID":"881d0167-3d13-4db8-b4ea-7d968140adf7","Type":"ContainerDied","Data":"c5253449b11277d17740c08125970911ef6a375181e5b66db914cfadc938dae0"}
May 27 18:39:09.559299 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:09.559262    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26zf4" event={"ID":"881d0167-3d13-4db8-b4ea-7d968140adf7","Type":"ContainerStarted","Data":"9643a9a7e3dfe5129e6b9a2db8929a2f933d86783c6e739945c08fd87553cbfa"}
May 27 18:39:09.559299 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:09.559299    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-26zf4" event={"ID":"881d0167-3d13-4db8-b4ea-7d968140adf7","Type":"ContainerStarted","Data":"a617ef5751b30009d76ffad7a4d2fbded4825e518e5acb1f7649cc454e8b8653"}
May 27 18:39:09.583855 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:09.583802    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-26zf4" podStartSLOduration=2.706690103 podStartE2EDuration="3.583787089s" podCreationTimestamp="2026-05-27 18:39:06 +0000 UTC" firstStartedPulling="2026-05-27 18:39:07.425181938 +0000 UTC m=+196.075404511" lastFinishedPulling="2026-05-27 18:39:08.302278923 +0000 UTC m=+196.952501497" observedRunningTime="2026-05-27 18:39:09.582604437 +0000 UTC m=+198.232827033" watchObservedRunningTime="2026-05-27 18:39:09.583787089 +0000 UTC m=+198.234009686"
May 27 18:39:14.653766 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:14.653728    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" podUID="9eb2764a-c6e1-4ac8-b1a6-26586e23efeb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 18:39:14.654126 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:14.653796    2571 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv"
May 27 18:39:14.654299 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:14.654270    2571 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"60d70900db435e239809e2e4b0d0246eb2061ce79e9fad79cb3d2af1b69f4a26"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 27 18:39:14.654341 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:14.654319    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" podUID="9eb2764a-c6e1-4ac8-b1a6-26586e23efeb" containerName="service-proxy" containerID="cri-o://60d70900db435e239809e2e4b0d0246eb2061ce79e9fad79cb3d2af1b69f4a26" gracePeriod=30
May 27 18:39:15.580580 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:15.580541    2571 generic.go:358] "Generic (PLEG): container finished" podID="9eb2764a-c6e1-4ac8-b1a6-26586e23efeb" containerID="60d70900db435e239809e2e4b0d0246eb2061ce79e9fad79cb3d2af1b69f4a26" exitCode=2
May 27 18:39:15.580746 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:15.580606    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" event={"ID":"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb","Type":"ContainerDied","Data":"60d70900db435e239809e2e4b0d0246eb2061ce79e9fad79cb3d2af1b69f4a26"}
May 27 18:39:15.580746 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:15.580644    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66f74b67cb-gcwlv" event={"ID":"9eb2764a-c6e1-4ac8-b1a6-26586e23efeb","Type":"ContainerStarted","Data":"87e0875332e28ec3829ba373e7569c1f15e65ff139be425eb799eeda75d3804e"}
May 27 18:39:28.935053 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:28.934984    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0" containerName="registry" containerID="cri-o://d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652" gracePeriod=30
May 27 18:39:29.168624 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.168600    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:39:29.338702 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338645    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-bound-sa-token\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.338860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338744    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-certificates\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.338860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338768    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-installation-pull-secrets\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.338860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338785    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.338860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338812    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/140c52f5-3164-49e2-bf71-d3bb398bfec0-ca-trust-extracted\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.338860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338836    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-image-registry-private-configuration\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.338860 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338852    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7bmz\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-kube-api-access-k7bmz\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.339150 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.338883    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-trusted-ca\") pod \"140c52f5-3164-49e2-bf71-d3bb398bfec0\" (UID: \"140c52f5-3164-49e2-bf71-d3bb398bfec0\") "
May 27 18:39:29.339285 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.339224    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:39:29.339433 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.339407    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 18:39:29.341332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.341294    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:39:29.341501 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.341480    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:39:29.341588 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.341539    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:39:29.341668 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.341643    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 18:39:29.341725 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.341707    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-kube-api-access-k7bmz" (OuterVolumeSpecName: "kube-api-access-k7bmz") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "kube-api-access-k7bmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:39:29.347467 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.347438    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/140c52f5-3164-49e2-bf71-d3bb398bfec0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "140c52f5-3164-49e2-bf71-d3bb398bfec0" (UID: "140c52f5-3164-49e2-bf71-d3bb398bfec0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440357    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-certificates\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440400    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-installation-pull-secrets\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440429    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-registry-tls\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440446    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/140c52f5-3164-49e2-bf71-d3bb398bfec0-ca-trust-extracted\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440461    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/140c52f5-3164-49e2-bf71-d3bb398bfec0-image-registry-private-configuration\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440477    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7bmz\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-kube-api-access-k7bmz\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440498    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/140c52f5-3164-49e2-bf71-d3bb398bfec0-trusted-ca\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.443652 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.440512    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/140c52f5-3164-49e2-bf71-d3bb398bfec0-bound-sa-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:39:29.618395 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.618308    2571 generic.go:358] "Generic (PLEG): container finished" podID="140c52f5-3164-49e2-bf71-d3bb398bfec0" containerID="d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652" exitCode=0
May 27 18:39:29.618395 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.618375    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" event={"ID":"140c52f5-3164-49e2-bf71-d3bb398bfec0","Type":"ContainerDied","Data":"d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652"}
May 27 18:39:29.618603 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.618394    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m"
May 27 18:39:29.618603 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.618411    2571 scope.go:117] "RemoveContainer" containerID="d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652"
May 27 18:39:29.618603 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.618401    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5897f96cdc-pcq4m" event={"ID":"140c52f5-3164-49e2-bf71-d3bb398bfec0","Type":"ContainerDied","Data":"d0d6a72545622c4d2385e2de116f18172f48e48446dbc95e119e933ad46c4288"}
May 27 18:39:29.626945 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.626927    2571 scope.go:117] "RemoveContainer" containerID="d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652"
May 27 18:39:29.627185 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:39:29.627168    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652\": container with ID starting with d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652 not found: ID does not exist" containerID="d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652"
May 27 18:39:29.627234 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.627193    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652"} err="failed to get container status \"d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652\": rpc error: code = NotFound desc = could not find container \"d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652\": container with ID starting with d1962a4253ccb2c07928b7106435c8c5e0c70996923e25cb7c24c22805da4652 not found: ID does not exist"
May 27 18:39:29.638763 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.638741    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5897f96cdc-pcq4m"]
May 27 18:39:29.642733 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.642708    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5897f96cdc-pcq4m"]
May 27 18:39:29.984664 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:39:29.984587    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0" path="/var/lib/kubelet/pods/140c52f5-3164-49e2-bf71-d3bb398bfec0/volumes"
May 27 18:40:02.790670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:02.790615    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:40:02.793044 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:02.793019    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d7fbf16-8394-4c75-ac14-50fae454a40b-metrics-certs\") pod \"network-metrics-daemon-q6fb5\" (UID: \"3d7fbf16-8394-4c75-ac14-50fae454a40b\") " pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:40:02.987388 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:02.987357    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zr9kw\""
May 27 18:40:02.994093 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:02.994070    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6fb5"
May 27 18:40:03.118039 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:03.117868    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6fb5"]
May 27 18:40:03.120582 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:40:03.120549    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7fbf16_8394_4c75_ac14_50fae454a40b.slice/crio-7ef522a4cd360e85d2ffd4076489c9cc265d913332626acff68c7b7b2d165cd4 WatchSource:0}: Error finding container 7ef522a4cd360e85d2ffd4076489c9cc265d913332626acff68c7b7b2d165cd4: Status 404 returned error can't find the container with id 7ef522a4cd360e85d2ffd4076489c9cc265d913332626acff68c7b7b2d165cd4
May 27 18:40:03.711729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:03.711689    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6fb5" event={"ID":"3d7fbf16-8394-4c75-ac14-50fae454a40b","Type":"ContainerStarted","Data":"7ef522a4cd360e85d2ffd4076489c9cc265d913332626acff68c7b7b2d165cd4"}
May 27 18:40:04.715823 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:04.715783    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6fb5" event={"ID":"3d7fbf16-8394-4c75-ac14-50fae454a40b","Type":"ContainerStarted","Data":"05e0adf205c837d4841d4a55623553aa9117a471f8ff6582b291e4aff41b38e1"}
May 27 18:40:04.715823 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:04.715823    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6fb5" event={"ID":"3d7fbf16-8394-4c75-ac14-50fae454a40b","Type":"ContainerStarted","Data":"ce36bd7c2dbc3c95449dc50ada16314ded1a6038b9daabdd29ce07ab5aa16fb6"}
May 27 18:40:04.732189 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:04.732140    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q6fb5" podStartSLOduration=252.668159013 podStartE2EDuration="4m13.732125647s" podCreationTimestamp="2026-05-27 18:35:51 +0000 UTC" firstStartedPulling="2026-05-27 18:40:03.122214223 +0000 UTC m=+251.772436810" lastFinishedPulling="2026-05-27 18:40:04.18618086 +0000 UTC m=+252.836403444" observedRunningTime="2026-05-27 18:40:04.731694583 +0000 UTC m=+253.381917179" watchObservedRunningTime="2026-05-27 18:40:04.732125647 +0000 UTC m=+253.382348297"
May 27 18:40:30.421159 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:40:30.421098    2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs" podUID="8976770f-c3d9-467c-84da-c3ef195a9979"
May 27 18:40:30.783399 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:30.783368    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:40:34.441002 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:34.440936    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:40:34.443401 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:34.443381    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8976770f-c3d9-467c-84da-c3ef195a9979-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-kpdqs\" (UID: \"8976770f-c3d9-467c-84da-c3ef195a9979\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:40:34.686795 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:34.686761    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r4hb8\""
May 27 18:40:34.694877 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:34.694824    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"
May 27 18:40:34.816957 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:34.816924    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs"]
May 27 18:40:34.819750 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:40:34.819720    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8976770f_c3d9_467c_84da_c3ef195a9979.slice/crio-0fcf824202b72ec81d6de6c4825f2d498711c553915ab8325f54d7ba21d2fe0e WatchSource:0}: Error finding container 0fcf824202b72ec81d6de6c4825f2d498711c553915ab8325f54d7ba21d2fe0e: Status 404 returned error can't find the container with id 0fcf824202b72ec81d6de6c4825f2d498711c553915ab8325f54d7ba21d2fe0e
May 27 18:40:35.796895 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:35.796861    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs" event={"ID":"8976770f-c3d9-467c-84da-c3ef195a9979","Type":"ContainerStarted","Data":"0fcf824202b72ec81d6de6c4825f2d498711c553915ab8325f54d7ba21d2fe0e"}
May 27 18:40:36.800697 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:36.800658    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs" event={"ID":"8976770f-c3d9-467c-84da-c3ef195a9979","Type":"ContainerStarted","Data":"532b47f3477e2d278bde306c652fc332035213d7c8ccaadbf6007790ed691384"}
May 27 18:40:36.819944 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:36.819891    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-kpdqs" podStartSLOduration=281.591651024 podStartE2EDuration="4m42.81987643s" podCreationTimestamp="2026-05-27 18:35:54 +0000 UTC" firstStartedPulling="2026-05-27 18:40:34.821483978 +0000 UTC m=+283.471706551" lastFinishedPulling="2026-05-27 18:40:36.04970938 +0000 UTC m=+284.699931957" observedRunningTime="2026-05-27 18:40:36.818855373 +0000 UTC m=+285.469077971" watchObservedRunningTime="2026-05-27 18:40:36.81987643 +0000 UTC m=+285.470099026"
May 27 18:40:51.815510 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:40:51.815477    2571 kubelet.go:1628] "Image garbage collection succeeded"
May 27 18:42:26.539731 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.539691    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ptxx2"]
May 27 18:42:26.540210 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.539938    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0" containerName="registry"
May 27 18:42:26.540210 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.539950    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0" containerName="registry"
May 27 18:42:26.540210 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.539989    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="140c52f5-3164-49e2-bf71-d3bb398bfec0" containerName="registry"
May 27 18:42:26.542667 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.542651    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.545312 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.545288    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 27 18:42:26.545458 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.545405    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 27 18:42:26.546337 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.546317    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5sccs\""
May 27 18:42:26.551985 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.551950    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ptxx2"]
May 27 18:42:26.636246 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.636209    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/306860dc-090e-4e1b-ba07-1ffa796fe9e9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ptxx2\" (UID: \"306860dc-090e-4e1b-ba07-1ffa796fe9e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.636246 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.636250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg2r6\" (UniqueName: \"kubernetes.io/projected/306860dc-090e-4e1b-ba07-1ffa796fe9e9-kube-api-access-wg2r6\") pod \"cert-manager-cainjector-68b757865b-ptxx2\" (UID: \"306860dc-090e-4e1b-ba07-1ffa796fe9e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.736969 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.736932    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wg2r6\" (UniqueName: \"kubernetes.io/projected/306860dc-090e-4e1b-ba07-1ffa796fe9e9-kube-api-access-wg2r6\") pod \"cert-manager-cainjector-68b757865b-ptxx2\" (UID: \"306860dc-090e-4e1b-ba07-1ffa796fe9e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.737149 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.737033    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/306860dc-090e-4e1b-ba07-1ffa796fe9e9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ptxx2\" (UID: \"306860dc-090e-4e1b-ba07-1ffa796fe9e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.745693 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.745669    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/306860dc-090e-4e1b-ba07-1ffa796fe9e9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ptxx2\" (UID: \"306860dc-090e-4e1b-ba07-1ffa796fe9e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.745818 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.745716    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg2r6\" (UniqueName: \"kubernetes.io/projected/306860dc-090e-4e1b-ba07-1ffa796fe9e9-kube-api-access-wg2r6\") pod \"cert-manager-cainjector-68b757865b-ptxx2\" (UID: \"306860dc-090e-4e1b-ba07-1ffa796fe9e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.852129 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.852046    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2"
May 27 18:42:26.976164 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.976117    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ptxx2"]
May 27 18:42:26.979089 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:42:26.979053    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod306860dc_090e_4e1b_ba07_1ffa796fe9e9.slice/crio-c69ffe312090eb9e4f980e5c78dbd3e823fe910e44725a86d501609e4f047b90 WatchSource:0}: Error finding container c69ffe312090eb9e4f980e5c78dbd3e823fe910e44725a86d501609e4f047b90: Status 404 returned error can't find the container with id c69ffe312090eb9e4f980e5c78dbd3e823fe910e44725a86d501609e4f047b90
May 27 18:42:26.980824 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:26.980804    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:42:27.079511 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:27.079477    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2" event={"ID":"306860dc-090e-4e1b-ba07-1ffa796fe9e9","Type":"ContainerStarted","Data":"c69ffe312090eb9e4f980e5c78dbd3e823fe910e44725a86d501609e4f047b90"}
May 27 18:42:30.089110 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:30.089066    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2" event={"ID":"306860dc-090e-4e1b-ba07-1ffa796fe9e9","Type":"ContainerStarted","Data":"43926b84369d76092281f52350f23e2a78d680a4008676f5d791d1c8b6689f04"}
May 27 18:42:30.105400 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:30.105344    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-ptxx2" podStartSLOduration=1.591769027 podStartE2EDuration="4.105329239s" podCreationTimestamp="2026-05-27 18:42:26 +0000 UTC" firstStartedPulling="2026-05-27 18:42:26.98094406 +0000 UTC m=+395.631166633" lastFinishedPulling="2026-05-27 18:42:29.494504268 +0000 UTC m=+398.144726845" observedRunningTime="2026-05-27 18:42:30.103313905 +0000 UTC m=+398.753536516" watchObservedRunningTime="2026-05-27 18:42:30.105329239 +0000 UTC m=+398.755551834"
May 27 18:42:55.495678 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.495640    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"]
May 27 18:42:55.499979 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.499955    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.502814 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.502791    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 27 18:42:55.503149 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.503131    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 27 18:42:55.503309 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.503290    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 27 18:42:55.503368 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.503327    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f4w94\""
May 27 18:42:55.507298 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.507280    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 27 18:42:55.511486 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.511459    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"]
May 27 18:42:55.531969 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.531938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21fde883-bdee-4d24-9aff-61cac5090838-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.532071 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.531987    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfg7\" (UniqueName: \"kubernetes.io/projected/21fde883-bdee-4d24-9aff-61cac5090838-kube-api-access-ctfg7\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.532071 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.532052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21fde883-bdee-4d24-9aff-61cac5090838-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.633404 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.633359    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21fde883-bdee-4d24-9aff-61cac5090838-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.633639 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.633416    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21fde883-bdee-4d24-9aff-61cac5090838-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.633639 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.633461    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfg7\" (UniqueName: \"kubernetes.io/projected/21fde883-bdee-4d24-9aff-61cac5090838-kube-api-access-ctfg7\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.635959 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.635927    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21fde883-bdee-4d24-9aff-61cac5090838-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.636067 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.636045    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21fde883-bdee-4d24-9aff-61cac5090838-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.641112 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.641092    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfg7\" (UniqueName: \"kubernetes.io/projected/21fde883-bdee-4d24-9aff-61cac5090838-kube-api-access-ctfg7\") pod \"opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd\" (UID: \"21fde883-bdee-4d24-9aff-61cac5090838\") " pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.810566 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.810459    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:55.942768 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:55.942737    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"]
May 27 18:42:55.945772 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:42:55.945746    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fde883_bdee_4d24_9aff_61cac5090838.slice/crio-bad2889b9c4a4b65881dd856d2260dfcfe7fe54dd0a12803c0235fcbca7c7dc7 WatchSource:0}: Error finding container bad2889b9c4a4b65881dd856d2260dfcfe7fe54dd0a12803c0235fcbca7c7dc7: Status 404 returned error can't find the container with id bad2889b9c4a4b65881dd856d2260dfcfe7fe54dd0a12803c0235fcbca7c7dc7
May 27 18:42:56.157139 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:56.157049    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd" event={"ID":"21fde883-bdee-4d24-9aff-61cac5090838","Type":"ContainerStarted","Data":"bad2889b9c4a4b65881dd856d2260dfcfe7fe54dd0a12803c0235fcbca7c7dc7"}
May 27 18:42:59.167581 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:59.167470    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd" event={"ID":"21fde883-bdee-4d24-9aff-61cac5090838","Type":"ContainerStarted","Data":"e99801081715e90981271bc99404202a121941424e75962f1f9208ef8ac860eb"}
May 27 18:42:59.167581 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:59.167571    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:42:59.190292 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:42:59.190241    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd" podStartSLOduration=1.385105753 podStartE2EDuration="4.19022426s" podCreationTimestamp="2026-05-27 18:42:55 +0000 UTC" firstStartedPulling="2026-05-27 18:42:55.948142786 +0000 UTC m=+424.598365359" lastFinishedPulling="2026-05-27 18:42:58.753261277 +0000 UTC m=+427.403483866" observedRunningTime="2026-05-27 18:42:59.188796207 +0000 UTC m=+427.839018803" watchObservedRunningTime="2026-05-27 18:42:59.19022426 +0000 UTC m=+427.840446857"
May 27 18:43:10.171862 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:10.171825    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd"
May 27 18:43:16.945006 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.944921    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-hw57s"]
May 27 18:43:16.947588 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.947571    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:16.952089 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.952070    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 27 18:43:16.952331 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.952311    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m7npj\""
May 27 18:43:16.960748 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.960725    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-hw57s"]
May 27 18:43:16.985165 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.985134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:16.985334 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:16.985174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2cs\" (UniqueName: \"kubernetes.io/projected/a85e7254-4509-4e58-8c92-534486a3c999-kube-api-access-nm2cs\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:17.086499 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:17.086462    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:17.086499 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:17.086505    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2cs\" (UniqueName: \"kubernetes.io/projected/a85e7254-4509-4e58-8c92-534486a3c999-kube-api-access-nm2cs\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:17.086730 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:43:17.086709    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 27 18:43:17.086811 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:43:17.086801    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert podName:a85e7254-4509-4e58-8c92-534486a3c999 nodeName:}" failed. No retries permitted until 2026-05-27 18:43:17.586773332 +0000 UTC m=+446.236995905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert") pod "odh-model-controller-858dbf95b8-hw57s" (UID: "a85e7254-4509-4e58-8c92-534486a3c999") : secret "odh-model-controller-webhook-cert" not found
May 27 18:43:17.114427 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:17.114392    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2cs\" (UniqueName: \"kubernetes.io/projected/a85e7254-4509-4e58-8c92-534486a3c999-kube-api-access-nm2cs\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:17.591045 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:17.591010    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:17.591249 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:43:17.591123    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 27 18:43:17.591249 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:43:17.591181    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert podName:a85e7254-4509-4e58-8c92-534486a3c999 nodeName:}" failed. No retries permitted until 2026-05-27 18:43:18.591167129 +0000 UTC m=+447.241389703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert") pod "odh-model-controller-858dbf95b8-hw57s" (UID: "a85e7254-4509-4e58-8c92-534486a3c999") : secret "odh-model-controller-webhook-cert" not found
May 27 18:43:18.598707 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:18.598666    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:18.601053 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:18.601023    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a85e7254-4509-4e58-8c92-534486a3c999-cert\") pod \"odh-model-controller-858dbf95b8-hw57s\" (UID: \"a85e7254-4509-4e58-8c92-534486a3c999\") " pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:18.757439 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:18.757400    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:18.883021 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:18.882950    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-hw57s"]
May 27 18:43:18.886107 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:43:18.886077    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda85e7254_4509_4e58_8c92_534486a3c999.slice/crio-ae261f04f039d72d0108a5b6ce83d1998e58fe1fc5974182fe978c935cfdcf04 WatchSource:0}: Error finding container ae261f04f039d72d0108a5b6ce83d1998e58fe1fc5974182fe978c935cfdcf04: Status 404 returned error can't find the container with id ae261f04f039d72d0108a5b6ce83d1998e58fe1fc5974182fe978c935cfdcf04
May 27 18:43:19.220340 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:19.220252    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s" event={"ID":"a85e7254-4509-4e58-8c92-534486a3c999","Type":"ContainerStarted","Data":"ae261f04f039d72d0108a5b6ce83d1998e58fe1fc5974182fe978c935cfdcf04"}
May 27 18:43:21.766489 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.766451    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-ptdpc"]
May 27 18:43:21.769932 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.769913    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:21.774456 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.774431    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 27 18:43:21.774975 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.774952    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8wbgw\""
May 27 18:43:21.787046 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.787014    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-ptdpc"]
May 27 18:43:21.825581 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.825534    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fwhz\" (UniqueName: \"kubernetes.io/projected/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-kube-api-access-5fwhz\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:21.825736 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.825629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-cert\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:21.927026 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.926978    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fwhz\" (UniqueName: \"kubernetes.io/projected/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-kube-api-access-5fwhz\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:21.927199 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.927079    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-cert\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:21.927262 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:43:21.927228    2571 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 27 18:43:21.927315 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:43:21.927300    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-cert podName:39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c nodeName:}" failed. No retries permitted until 2026-05-27 18:43:22.427279485 +0000 UTC m=+451.077502076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-cert") pod "kserve-controller-manager-856948b99f-ptdpc" (UID: "39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c") : secret "kserve-webhook-server-cert" not found
May 27 18:43:21.939397 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:21.939370    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fwhz\" (UniqueName: \"kubernetes.io/projected/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-kube-api-access-5fwhz\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:22.431916 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:22.431819    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-cert\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:22.434247 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:22.434225    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c-cert\") pod \"kserve-controller-manager-856948b99f-ptdpc\" (UID: \"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c\") " pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:22.683807 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:22.683710    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:22.811070 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:22.811039    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-ptdpc"]
May 27 18:43:22.812791 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:43:22.812759    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39cedbed_cb8d_41f1_a12f_2f6ca1e3fc2c.slice/crio-8e1b450548a0228bbbbfb1e95d85e86df37e5ac94a002d3f1a79597de1f17401 WatchSource:0}: Error finding container 8e1b450548a0228bbbbfb1e95d85e86df37e5ac94a002d3f1a79597de1f17401: Status 404 returned error can't find the container with id 8e1b450548a0228bbbbfb1e95d85e86df37e5ac94a002d3f1a79597de1f17401
May 27 18:43:23.240642 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:23.240607    2571 generic.go:358] "Generic (PLEG): container finished" podID="a85e7254-4509-4e58-8c92-534486a3c999" containerID="2c02aa257af7039dc469876630e4476995ca821437fca2ae96742c783533714a" exitCode=1
May 27 18:43:23.240850 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:23.240703    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s" event={"ID":"a85e7254-4509-4e58-8c92-534486a3c999","Type":"ContainerDied","Data":"2c02aa257af7039dc469876630e4476995ca821437fca2ae96742c783533714a"}
May 27 18:43:23.240931 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:23.240913    2571 scope.go:117] "RemoveContainer" containerID="2c02aa257af7039dc469876630e4476995ca821437fca2ae96742c783533714a"
May 27 18:43:23.241905 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:23.241775    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc" event={"ID":"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c","Type":"ContainerStarted","Data":"8e1b450548a0228bbbbfb1e95d85e86df37e5ac94a002d3f1a79597de1f17401"}
May 27 18:43:24.248173 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.248131    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s" event={"ID":"a85e7254-4509-4e58-8c92-534486a3c999","Type":"ContainerStarted","Data":"25af9b024b6abcdb9a630ad67a2ec8869cf9d3287c5ddba11a913e063d8d5c63"}
May 27 18:43:24.248575 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.248325    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:24.266894 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.266813    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s" podStartSLOduration=3.643695772 podStartE2EDuration="8.26677446s" podCreationTimestamp="2026-05-27 18:43:16 +0000 UTC" firstStartedPulling="2026-05-27 18:43:18.887357448 +0000 UTC m=+447.537580022" lastFinishedPulling="2026-05-27 18:43:23.510436132 +0000 UTC m=+452.160658710" observedRunningTime="2026-05-27 18:43:24.264794412 +0000 UTC m=+452.915017009" watchObservedRunningTime="2026-05-27 18:43:24.26677446 +0000 UTC m=+452.916997057"
May 27 18:43:24.685836 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.685755    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"]
May 27 18:43:24.688866 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.688846    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.692269 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.692241    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p2h25\""
May 27 18:43:24.692424 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.692286    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 18:43:24.692586 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.692564    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 27 18:43:24.692683 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.692589    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 18:43:24.693053 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.693039    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 27 18:43:24.699188 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.699168    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"]
May 27 18:43:24.747806 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.747774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhpsf\" (UniqueName: \"kubernetes.io/projected/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-kube-api-access-xhpsf\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.747806 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.747823    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-tls-certs\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.748033 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.747854    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-tmp\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.848993 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.848960    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-tls-certs\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.849180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.849005    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-tmp\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.849180 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.849042    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhpsf\" (UniqueName: \"kubernetes.io/projected/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-kube-api-access-xhpsf\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.851375 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.851342    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-tmp\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.851568 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.851550    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-tls-certs\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.856793 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.856769    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhpsf\" (UniqueName: \"kubernetes.io/projected/dde5fb05-e226-445a-b5e2-b3e8ddaa11a3-kube-api-access-xhpsf\") pod \"kube-auth-proxy-9cf5b4778-xxb4p\" (UID: \"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3\") " pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:24.998408 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:24.998374    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"
May 27 18:43:25.124263 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:25.124235    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p"]
May 27 18:43:25.127331 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:43:25.127302    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde5fb05_e226_445a_b5e2_b3e8ddaa11a3.slice/crio-62ad77bea95cdb161f6d756f2fb409851d3f5faa2f5db00eaa7039c2ee0b6a12 WatchSource:0}: Error finding container 62ad77bea95cdb161f6d756f2fb409851d3f5faa2f5db00eaa7039c2ee0b6a12: Status 404 returned error can't find the container with id 62ad77bea95cdb161f6d756f2fb409851d3f5faa2f5db00eaa7039c2ee0b6a12
May 27 18:43:25.252154 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:25.252059    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p" event={"ID":"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3","Type":"ContainerStarted","Data":"62ad77bea95cdb161f6d756f2fb409851d3f5faa2f5db00eaa7039c2ee0b6a12"}
May 27 18:43:28.263943 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:28.263893    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc" event={"ID":"39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c","Type":"ContainerStarted","Data":"2e6c9f995dbbd786e26f1436abcbea3aaccc638ebdf07110c13ef2c5405d646c"}
May 27 18:43:28.264364 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:28.264092    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:43:28.281142 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:28.281092    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc" podStartSLOduration=2.444880096 podStartE2EDuration="7.281078533s" podCreationTimestamp="2026-05-27 18:43:21 +0000 UTC" firstStartedPulling="2026-05-27 18:43:22.814138145 +0000 UTC m=+451.464360722" lastFinishedPulling="2026-05-27 18:43:27.65033658 +0000 UTC m=+456.300559159" observedRunningTime="2026-05-27 18:43:28.279494296 +0000 UTC m=+456.929716892" watchObservedRunningTime="2026-05-27 18:43:28.281078533 +0000 UTC m=+456.931301129"
May 27 18:43:29.268496 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:29.268456    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p" event={"ID":"dde5fb05-e226-445a-b5e2-b3e8ddaa11a3","Type":"ContainerStarted","Data":"0e199b99764d8dccd4a2530e3ce02ad07ab83e0eb7b00f929d4b45a443001c9a"}
May 27 18:43:29.285433 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:29.285382    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9cf5b4778-xxb4p" podStartSLOduration=1.6341473899999999 podStartE2EDuration="5.285368088s" podCreationTimestamp="2026-05-27 18:43:24 +0000 UTC" firstStartedPulling="2026-05-27 18:43:25.129270144 +0000 UTC m=+453.779492726" lastFinishedPulling="2026-05-27 18:43:28.780490845 +0000 UTC m=+457.430713424" observedRunningTime="2026-05-27 18:43:29.284293484 +0000 UTC m=+457.934516082" watchObservedRunningTime="2026-05-27 18:43:29.285368088 +0000 UTC m=+457.935590683"
May 27 18:43:35.253990 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:35.253949    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-hw57s"
May 27 18:43:40.301074 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.301043    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"]
May 27 18:43:40.307925 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.307906    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.312733 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.310690    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 27 18:43:40.312733 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.311039    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-vrfhb\""
May 27 18:43:40.312733 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.311393    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 27 18:43:40.324493 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.324466    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"]
May 27 18:43:40.477790 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.477749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/375ba7b8-21f0-463a-936f-ccde43ae8497-operator-config\") pod \"servicemesh-operator3-55f49c5f94-6k6qg\" (UID: \"375ba7b8-21f0-463a-936f-ccde43ae8497\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.477966 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.477873    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6wtn\" (UniqueName: \"kubernetes.io/projected/375ba7b8-21f0-463a-936f-ccde43ae8497-kube-api-access-t6wtn\") pod \"servicemesh-operator3-55f49c5f94-6k6qg\" (UID: \"375ba7b8-21f0-463a-936f-ccde43ae8497\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.578640 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.578554    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6wtn\" (UniqueName: \"kubernetes.io/projected/375ba7b8-21f0-463a-936f-ccde43ae8497-kube-api-access-t6wtn\") pod \"servicemesh-operator3-55f49c5f94-6k6qg\" (UID: \"375ba7b8-21f0-463a-936f-ccde43ae8497\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.578640 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.578602    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/375ba7b8-21f0-463a-936f-ccde43ae8497-operator-config\") pod \"servicemesh-operator3-55f49c5f94-6k6qg\" (UID: \"375ba7b8-21f0-463a-936f-ccde43ae8497\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.581093 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.581070    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/375ba7b8-21f0-463a-936f-ccde43ae8497-operator-config\") pod \"servicemesh-operator3-55f49c5f94-6k6qg\" (UID: \"375ba7b8-21f0-463a-936f-ccde43ae8497\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.588164 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.588143    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6wtn\" (UniqueName: \"kubernetes.io/projected/375ba7b8-21f0-463a-936f-ccde43ae8497-kube-api-access-t6wtn\") pod \"servicemesh-operator3-55f49c5f94-6k6qg\" (UID: \"375ba7b8-21f0-463a-936f-ccde43ae8497\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.621113 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.621076    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:40.769294 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:40.769260    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"]
May 27 18:43:40.772592 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:43:40.772559    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375ba7b8_21f0_463a_936f_ccde43ae8497.slice/crio-dce6d303ebc513f6c7ab7331e3f5170c5d6cf44a0558d63f3ff692f7339dbfac WatchSource:0}: Error finding container dce6d303ebc513f6c7ab7331e3f5170c5d6cf44a0558d63f3ff692f7339dbfac: Status 404 returned error can't find the container with id dce6d303ebc513f6c7ab7331e3f5170c5d6cf44a0558d63f3ff692f7339dbfac
May 27 18:43:41.299533 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:41.299479    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg" event={"ID":"375ba7b8-21f0-463a-936f-ccde43ae8497","Type":"ContainerStarted","Data":"dce6d303ebc513f6c7ab7331e3f5170c5d6cf44a0558d63f3ff692f7339dbfac"}
May 27 18:43:44.318540 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:44.318485    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg" event={"ID":"375ba7b8-21f0-463a-936f-ccde43ae8497","Type":"ContainerStarted","Data":"20044d92f6a4c7391521c58996118b09ae684cf14b28824ef0174d6e2b3ebc1b"}
May 27 18:43:44.318977 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:44.318624    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:44.345077 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:44.345008    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg" podStartSLOduration=1.863020227 podStartE2EDuration="4.344992669s" podCreationTimestamp="2026-05-27 18:43:40 +0000 UTC" firstStartedPulling="2026-05-27 18:43:40.775022426 +0000 UTC m=+469.425245001" lastFinishedPulling="2026-05-27 18:43:43.256994858 +0000 UTC m=+471.907217443" observedRunningTime="2026-05-27 18:43:44.342321749 +0000 UTC m=+472.992544344" watchObservedRunningTime="2026-05-27 18:43:44.344992669 +0000 UTC m=+472.995215266"
May 27 18:43:51.205837 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.205802    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"]
May 27 18:43:51.208824 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.208807    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.212143 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.212120    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 27 18:43:51.212255 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.212157    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 27 18:43:51.213422 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.213400    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mz7db\""
May 27 18:43:51.213663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.213648    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 27 18:43:51.213731 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.213652    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 27 18:43:51.222060 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.222028    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"]
May 27 18:43:51.365945 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.365907    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6f2477e-1e1d-400b-89c6-79f4219c7e58-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.365945 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.365948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.366187 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.365979    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.366187 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.366013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.366187 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.366030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvs7v\" (UniqueName: \"kubernetes.io/projected/a6f2477e-1e1d-400b-89c6-79f4219c7e58-kube-api-access-tvs7v\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.366187 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.366104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.366187 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.366135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467572 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467473    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467572 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467511    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvs7v\" (UniqueName: \"kubernetes.io/projected/a6f2477e-1e1d-400b-89c6-79f4219c7e58-kube-api-access-tvs7v\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467572 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467566    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467835 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467590    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467835 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467658    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6f2477e-1e1d-400b-89c6-79f4219c7e58-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467835 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467700    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.467835 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.467743    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.468319 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.468291    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.470032 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.470009    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6f2477e-1e1d-400b-89c6-79f4219c7e58-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.470447 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.470428    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.470570 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.470553    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.470623 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.470565    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6f2477e-1e1d-400b-89c6-79f4219c7e58-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.482276 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.482246    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6f2477e-1e1d-400b-89c6-79f4219c7e58-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.482372 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.482283    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvs7v\" (UniqueName: \"kubernetes.io/projected/a6f2477e-1e1d-400b-89c6-79f4219c7e58-kube-api-access-tvs7v\") pod \"istiod-openshift-gateway-798958bb55-6f67q\" (UID: \"a6f2477e-1e1d-400b-89c6-79f4219c7e58\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.518203 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.518167    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:51.660936 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:51.660877    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"]
May 27 18:43:51.663958 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:43:51.663918    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f2477e_1e1d_400b_89c6_79f4219c7e58.slice/crio-e6c74d1f6b2e5a509e3d487e5c3132df232e45f2b6f9e7229806941a5bb78f6c WatchSource:0}: Error finding container e6c74d1f6b2e5a509e3d487e5c3132df232e45f2b6f9e7229806941a5bb78f6c: Status 404 returned error can't find the container with id e6c74d1f6b2e5a509e3d487e5c3132df232e45f2b6f9e7229806941a5bb78f6c
May 27 18:43:52.343011 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:52.342971    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q" event={"ID":"a6f2477e-1e1d-400b-89c6-79f4219c7e58","Type":"ContainerStarted","Data":"e6c74d1f6b2e5a509e3d487e5c3132df232e45f2b6f9e7229806941a5bb78f6c"}
May 27 18:43:54.272856 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:54.272818    2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 27 18:43:54.273108 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:54.272888    2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 27 18:43:54.350549 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:54.350485    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q" event={"ID":"a6f2477e-1e1d-400b-89c6-79f4219c7e58","Type":"ContainerStarted","Data":"7d7229591cff7c3862dd109ec1841cbf1966aee2aa163a624d5f403449beb637"}
May 27 18:43:54.350709 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:54.350624    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:54.374194 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:54.373706    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q" podStartSLOduration=0.766971493 podStartE2EDuration="3.373687841s" podCreationTimestamp="2026-05-27 18:43:51 +0000 UTC" firstStartedPulling="2026-05-27 18:43:51.665880478 +0000 UTC m=+480.316103053" lastFinishedPulling="2026-05-27 18:43:54.272596824 +0000 UTC m=+482.922819401" observedRunningTime="2026-05-27 18:43:54.371496991 +0000 UTC m=+483.021719588" watchObservedRunningTime="2026-05-27 18:43:54.373687841 +0000 UTC m=+483.023910439"
May 27 18:43:55.322665 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:55.322630    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6k6qg"
May 27 18:43:55.354877 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:55.354845    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-6f67q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 27 18:43:55.355027 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:55.354928    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q" podUID="a6f2477e-1e1d-400b-89c6-79f4219c7e58" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 18:43:58.354273 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:58.354235    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6f67q"
May 27 18:43:59.273991 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:43:59.273957    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-ptdpc"
May 27 18:44:46.432469 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.432389    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6w2xx"]
May 27 18:44:46.434622 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.434599    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:44:46.437003 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.436981    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 27 18:44:46.437105 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.437026    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 27 18:44:46.437105 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.437063    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fjnnj\""
May 27 18:44:46.448497 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.448472    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6w2xx"]
May 27 18:44:46.501854 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.501816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6qkt\" (UniqueName: \"kubernetes.io/projected/90f352e6-9c5c-4cca-8510-766c689a73a9-kube-api-access-x6qkt\") pod \"authorino-operator-657f44b778-6w2xx\" (UID: \"90f352e6-9c5c-4cca-8510-766c689a73a9\") " pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:44:46.603203 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.603163    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6qkt\" (UniqueName: \"kubernetes.io/projected/90f352e6-9c5c-4cca-8510-766c689a73a9-kube-api-access-x6qkt\") pod \"authorino-operator-657f44b778-6w2xx\" (UID: \"90f352e6-9c5c-4cca-8510-766c689a73a9\") " pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:44:46.611408 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.611379    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6qkt\" (UniqueName: \"kubernetes.io/projected/90f352e6-9c5c-4cca-8510-766c689a73a9-kube-api-access-x6qkt\") pod \"authorino-operator-657f44b778-6w2xx\" (UID: \"90f352e6-9c5c-4cca-8510-766c689a73a9\") " pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:44:46.744999 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.744969    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:44:46.878345 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:46.878252    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6w2xx"]
May 27 18:44:46.881575 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:44:46.881546    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f352e6_9c5c_4cca_8510_766c689a73a9.slice/crio-682d25190430bba0247e823bf47c82f4bb0e9e01ddd4aea82ba36f032cc4a378 WatchSource:0}: Error finding container 682d25190430bba0247e823bf47c82f4bb0e9e01ddd4aea82ba36f032cc4a378: Status 404 returned error can't find the container with id 682d25190430bba0247e823bf47c82f4bb0e9e01ddd4aea82ba36f032cc4a378
May 27 18:44:47.528767 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:47.528731    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx" event={"ID":"90f352e6-9c5c-4cca-8510-766c689a73a9","Type":"ContainerStarted","Data":"682d25190430bba0247e823bf47c82f4bb0e9e01ddd4aea82ba36f032cc4a378"}
May 27 18:44:49.537294 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:49.537256    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx" event={"ID":"90f352e6-9c5c-4cca-8510-766c689a73a9","Type":"ContainerStarted","Data":"b2c3842295cf766e772d5c09769081d393f3e3675e96bd6db03274b089c26439"}
May 27 18:44:49.537787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:49.537322    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:44:49.560751 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:49.560699    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx" podStartSLOduration=1.823895498 podStartE2EDuration="3.560681846s" podCreationTimestamp="2026-05-27 18:44:46 +0000 UTC" firstStartedPulling="2026-05-27 18:44:46.883620044 +0000 UTC m=+535.533842618" lastFinishedPulling="2026-05-27 18:44:48.620406387 +0000 UTC m=+537.270628966" observedRunningTime="2026-05-27 18:44:49.559884691 +0000 UTC m=+538.210107290" watchObservedRunningTime="2026-05-27 18:44:49.560681846 +0000 UTC m=+538.210904442"
May 27 18:44:52.611374 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.611328    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"]
May 27 18:44:52.613717 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.613693    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:44:52.616240 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.616219    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 27 18:44:52.616335 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.616219    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-clzhm\""
May 27 18:44:52.629271 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.629245    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"]
May 27 18:44:52.755485 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.755442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssl4z\" (UniqueName: \"kubernetes.io/projected/4cb14f5e-6c64-4566-9331-805fee05cc78-kube-api-access-ssl4z\") pod \"dns-operator-controller-manager-648d5c98bc-wfg4m\" (UID: \"4cb14f5e-6c64-4566-9331-805fee05cc78\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:44:52.855877 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.855842    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl4z\" (UniqueName: \"kubernetes.io/projected/4cb14f5e-6c64-4566-9331-805fee05cc78-kube-api-access-ssl4z\") pod \"dns-operator-controller-manager-648d5c98bc-wfg4m\" (UID: \"4cb14f5e-6c64-4566-9331-805fee05cc78\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:44:52.864327 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.864259    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssl4z\" (UniqueName: \"kubernetes.io/projected/4cb14f5e-6c64-4566-9331-805fee05cc78-kube-api-access-ssl4z\") pod \"dns-operator-controller-manager-648d5c98bc-wfg4m\" (UID: \"4cb14f5e-6c64-4566-9331-805fee05cc78\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:44:52.924151 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:52.924117    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:44:53.070388 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:53.070355    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"]
May 27 18:44:53.072899 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:44:53.072866    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb14f5e_6c64_4566_9331_805fee05cc78.slice/crio-748639a5d355eb581acf22fdbaf6683c35ba5bf6d4851eafb7cf5265ea7e17aa WatchSource:0}: Error finding container 748639a5d355eb581acf22fdbaf6683c35ba5bf6d4851eafb7cf5265ea7e17aa: Status 404 returned error can't find the container with id 748639a5d355eb581acf22fdbaf6683c35ba5bf6d4851eafb7cf5265ea7e17aa
May 27 18:44:53.552478 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:53.552443    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m" event={"ID":"4cb14f5e-6c64-4566-9331-805fee05cc78","Type":"ContainerStarted","Data":"748639a5d355eb581acf22fdbaf6683c35ba5bf6d4851eafb7cf5265ea7e17aa"}
May 27 18:44:55.560964 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:55.560863    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m" event={"ID":"4cb14f5e-6c64-4566-9331-805fee05cc78","Type":"ContainerStarted","Data":"c8ebdf6d103537a9a2c6505cf69c02bd30c3361ed71c9afd230414b2c03c60c1"}
May 27 18:44:55.560964 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:55.560938    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:44:55.584707 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:55.584661    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m" podStartSLOduration=1.394988781 podStartE2EDuration="3.584647946s" podCreationTimestamp="2026-05-27 18:44:52 +0000 UTC" firstStartedPulling="2026-05-27 18:44:53.074901184 +0000 UTC m=+541.725123763" lastFinishedPulling="2026-05-27 18:44:55.26456035 +0000 UTC m=+543.914782928" observedRunningTime="2026-05-27 18:44:55.582900586 +0000 UTC m=+544.233123186" watchObservedRunningTime="2026-05-27 18:44:55.584647946 +0000 UTC m=+544.234870541"
May 27 18:44:57.106030 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.105994    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"]
May 27 18:44:57.109406 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.109385    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.112114 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.112093    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rtsds\""
May 27 18:44:57.120393 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.120368    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"]
May 27 18:44:57.290599 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.290542    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.290788 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.290692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4fk\" (UniqueName: \"kubernetes.io/projected/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-kube-api-access-9q4fk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.391946 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.391834    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.391946 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.391918    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4fk\" (UniqueName: \"kubernetes.io/projected/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-kube-api-access-9q4fk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.392288 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.392263    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.400463 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.400435    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4fk\" (UniqueName: \"kubernetes.io/projected/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-kube-api-access-9q4fk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.420075 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.420044    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:44:57.554392 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.554361    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"]
May 27 18:44:57.557070 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:44:57.557042    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa25158_5b43_4ec8_a72f_89a2cb944d0d.slice/crio-188c02114015d844eae54857e4f9737c5475794555e7be895d4c963d731d36e5 WatchSource:0}: Error finding container 188c02114015d844eae54857e4f9737c5475794555e7be895d4c963d731d36e5: Status 404 returned error can't find the container with id 188c02114015d844eae54857e4f9737c5475794555e7be895d4c963d731d36e5
May 27 18:44:57.568080 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:44:57.568048    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" event={"ID":"9fa25158-5b43-4ec8-a72f-89a2cb944d0d","Type":"ContainerStarted","Data":"188c02114015d844eae54857e4f9737c5475794555e7be895d4c963d731d36e5"}
May 27 18:45:00.543880 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:00.543846    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-6w2xx"
May 27 18:45:03.590556 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:03.590498    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" event={"ID":"9fa25158-5b43-4ec8-a72f-89a2cb944d0d","Type":"ContainerStarted","Data":"cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682"}
May 27 18:45:03.590976 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:03.590661    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:45:03.609585 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:03.609539    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" podStartSLOduration=1.157373655 podStartE2EDuration="6.609506228s" podCreationTimestamp="2026-05-27 18:44:57 +0000 UTC" firstStartedPulling="2026-05-27 18:44:57.55927917 +0000 UTC m=+546.209501744" lastFinishedPulling="2026-05-27 18:45:03.011411743 +0000 UTC m=+551.661634317" observedRunningTime="2026-05-27 18:45:03.60826752 +0000 UTC m=+552.258490155" watchObservedRunningTime="2026-05-27 18:45:03.609506228 +0000 UTC m=+552.259728823"
May 27 18:45:06.566675 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:06.566642    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wfg4m"
May 27 18:45:14.597116 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:14.597082    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:45:16.339584 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.339547    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"]
May 27 18:45:16.339954 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.339769    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" containerName="manager" containerID="cri-o://cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682" gracePeriod=2
May 27 18:45:16.341970 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.341934    2571 status_manager.go:895] "Failed to get status for pod" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" is forbidden: User \"system:node:ip-10-0-142-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-149.ec2.internal' and this object"
May 27 18:45:16.342830 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.342804    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"]
May 27 18:45:16.361160 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.361135    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"]
May 27 18:45:16.361581 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.361565    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" containerName="manager"
May 27 18:45:16.361636 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.361586    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" containerName="manager"
May 27 18:45:16.361670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.361662    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" containerName="manager"
May 27 18:45:16.364670 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.364652    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.367059 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.367033    2571 status_manager.go:895] "Failed to get status for pod" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" is forbidden: User \"system:node:ip-10-0-142-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-149.ec2.internal' and this object"
May 27 18:45:16.379407 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.379383    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"]
May 27 18:45:16.437504 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.437479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6njh\" (UniqueName: \"kubernetes.io/projected/83629d0d-17ea-4e72-87b7-42287c855d94-kube-api-access-t6njh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mlbbx\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.437655 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.437543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83629d0d-17ea-4e72-87b7-42287c855d94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mlbbx\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.538130 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.538102    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83629d0d-17ea-4e72-87b7-42287c855d94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mlbbx\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.538257 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.538234    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6njh\" (UniqueName: \"kubernetes.io/projected/83629d0d-17ea-4e72-87b7-42287c855d94-kube-api-access-t6njh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mlbbx\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.538461 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.538443    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83629d0d-17ea-4e72-87b7-42287c855d94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mlbbx\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.550200 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.550174    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6njh\" (UniqueName: \"kubernetes.io/projected/83629d0d-17ea-4e72-87b7-42287c855d94-kube-api-access-t6njh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mlbbx\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.581161 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.581142    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:45:16.583554 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.583509    2571 status_manager.go:895] "Failed to get status for pod" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" is forbidden: User \"system:node:ip-10-0-142-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-149.ec2.internal' and this object"
May 27 18:45:16.634787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.634719    2571 generic.go:358] "Generic (PLEG): container finished" podID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" containerID="cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682" exitCode=0
May 27 18:45:16.634787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.634761    2571 scope.go:117] "RemoveContainer" containerID="cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682"
May 27 18:45:16.634787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.634770    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr"
May 27 18:45:16.637271 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.637250    2571 status_manager.go:895] "Failed to get status for pod" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" is forbidden: User \"system:node:ip-10-0-142-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-149.ec2.internal' and this object"
May 27 18:45:16.638463 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.638447    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-extensions-socket-volume\") pod \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") "
May 27 18:45:16.638536 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.638475    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q4fk\" (UniqueName: \"kubernetes.io/projected/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-kube-api-access-9q4fk\") pod \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\" (UID: \"9fa25158-5b43-4ec8-a72f-89a2cb944d0d\") "
May 27 18:45:16.639038 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.639010    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9fa25158-5b43-4ec8-a72f-89a2cb944d0d" (UID: "9fa25158-5b43-4ec8-a72f-89a2cb944d0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 18:45:16.641058 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.641030    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-kube-api-access-9q4fk" (OuterVolumeSpecName: "kube-api-access-9q4fk") pod "9fa25158-5b43-4ec8-a72f-89a2cb944d0d" (UID: "9fa25158-5b43-4ec8-a72f-89a2cb944d0d"). InnerVolumeSpecName "kube-api-access-9q4fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:45:16.643115 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.643100    2571 scope.go:117] "RemoveContainer" containerID="cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682"
May 27 18:45:16.643381 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:45:16.643354    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682\": container with ID starting with cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682 not found: ID does not exist" containerID="cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682"
May 27 18:45:16.643429 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.643396    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682"} err="failed to get container status \"cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682\": rpc error: code = NotFound desc = could not find container \"cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682\": container with ID starting with cb65c78ce923b46b55a3abbcf1ea3c76cc541955795f20dfdb786ba76f3be682 not found: ID does not exist"
May 27 18:45:16.718413 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.718389    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:16.739044 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.739020    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-extensions-socket-volume\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:45:16.739136 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.739045    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q4fk\" (UniqueName: \"kubernetes.io/projected/9fa25158-5b43-4ec8-a72f-89a2cb944d0d-kube-api-access-9q4fk\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:45:16.855137 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.855113    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"]
May 27 18:45:16.857303 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:45:16.857277    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83629d0d_17ea_4e72_87b7_42287c855d94.slice/crio-7a80a12d01be6fdfd92a1b14f7e84e0ed655afb702693961357c60e4769fc439 WatchSource:0}: Error finding container 7a80a12d01be6fdfd92a1b14f7e84e0ed655afb702693961357c60e4769fc439: Status 404 returned error can't find the container with id 7a80a12d01be6fdfd92a1b14f7e84e0ed655afb702693961357c60e4769fc439
May 27 18:45:16.945647 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:16.945619    2571 status_manager.go:895] "Failed to get status for pod" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" is forbidden: User \"system:node:ip-10-0-142-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-149.ec2.internal' and this object"
May 27 18:45:17.640995 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:17.640962    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx" event={"ID":"83629d0d-17ea-4e72-87b7-42287c855d94","Type":"ContainerStarted","Data":"9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6"}
May 27 18:45:17.640995 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:17.640997    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx" event={"ID":"83629d0d-17ea-4e72-87b7-42287c855d94","Type":"ContainerStarted","Data":"7a80a12d01be6fdfd92a1b14f7e84e0ed655afb702693961357c60e4769fc439"}
May 27 18:45:17.641384 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:17.641075    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:17.643035 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:17.643015    2571 status_manager.go:895] "Failed to get status for pod" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-x5jzr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-x5jzr\" is forbidden: User \"system:node:ip-10-0-142-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-149.ec2.internal' and this object"
May 27 18:45:17.986339 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:17.986264    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa25158-5b43-4ec8-a72f-89a2cb944d0d" path="/var/lib/kubelet/pods/9fa25158-5b43-4ec8-a72f-89a2cb944d0d/volumes"
May 27 18:45:28.646431 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:28.646400    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:28.667880 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:28.667836    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx" podStartSLOduration=12.667822645 podStartE2EDuration="12.667822645s" podCreationTimestamp="2026-05-27 18:45:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:45:17.664038538 +0000 UTC m=+566.314261133" watchObservedRunningTime="2026-05-27 18:45:28.667822645 +0000 UTC m=+577.318045237"
May 27 18:45:31.723493 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.723458    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"]
May 27 18:45:31.723963 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.723683    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx" podUID="83629d0d-17ea-4e72-87b7-42287c855d94" containerName="manager" containerID="cri-o://9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6" gracePeriod=10
May 27 18:45:31.966876 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.966847    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:31.989309 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.989235    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"]
May 27 18:45:31.989513 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.989502    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83629d0d-17ea-4e72-87b7-42287c855d94" containerName="manager"
May 27 18:45:31.989513 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.989530    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="83629d0d-17ea-4e72-87b7-42287c855d94" containerName="manager"
May 27 18:45:31.989620 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.989583    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="83629d0d-17ea-4e72-87b7-42287c855d94" containerName="manager"
May 27 18:45:31.995178 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:31.995153    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.007412 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.007383    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"]
May 27 18:45:32.064197 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.064163    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6njh\" (UniqueName: \"kubernetes.io/projected/83629d0d-17ea-4e72-87b7-42287c855d94-kube-api-access-t6njh\") pod \"83629d0d-17ea-4e72-87b7-42287c855d94\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") "
May 27 18:45:32.064374 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.064263    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83629d0d-17ea-4e72-87b7-42287c855d94-extensions-socket-volume\") pod \"83629d0d-17ea-4e72-87b7-42287c855d94\" (UID: \"83629d0d-17ea-4e72-87b7-42287c855d94\") "
May 27 18:45:32.064468 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.064439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20819726-afb7-44a7-a81c-a0e35155a5a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-gkd5f\" (UID: \"20819726-afb7-44a7-a81c-a0e35155a5a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.064631 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.064581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg79v\" (UniqueName: \"kubernetes.io/projected/20819726-afb7-44a7-a81c-a0e35155a5a2-kube-api-access-hg79v\") pod \"kuadrant-operator-controller-manager-55c7f4c975-gkd5f\" (UID: \"20819726-afb7-44a7-a81c-a0e35155a5a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.064697 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.064677    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83629d0d-17ea-4e72-87b7-42287c855d94-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "83629d0d-17ea-4e72-87b7-42287c855d94" (UID: "83629d0d-17ea-4e72-87b7-42287c855d94"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 18:45:32.066409 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.066388    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83629d0d-17ea-4e72-87b7-42287c855d94-kube-api-access-t6njh" (OuterVolumeSpecName: "kube-api-access-t6njh") pod "83629d0d-17ea-4e72-87b7-42287c855d94" (UID: "83629d0d-17ea-4e72-87b7-42287c855d94"). InnerVolumeSpecName "kube-api-access-t6njh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:45:32.165711 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.165672    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20819726-afb7-44a7-a81c-a0e35155a5a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-gkd5f\" (UID: \"20819726-afb7-44a7-a81c-a0e35155a5a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.165897 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.165727    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg79v\" (UniqueName: \"kubernetes.io/projected/20819726-afb7-44a7-a81c-a0e35155a5a2-kube-api-access-hg79v\") pod \"kuadrant-operator-controller-manager-55c7f4c975-gkd5f\" (UID: \"20819726-afb7-44a7-a81c-a0e35155a5a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.165897 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.165791    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6njh\" (UniqueName: \"kubernetes.io/projected/83629d0d-17ea-4e72-87b7-42287c855d94-kube-api-access-t6njh\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:45:32.165897 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.165802    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83629d0d-17ea-4e72-87b7-42287c855d94-extensions-socket-volume\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:45:32.166129 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.166105    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20819726-afb7-44a7-a81c-a0e35155a5a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-gkd5f\" (UID: \"20819726-afb7-44a7-a81c-a0e35155a5a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.176653 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.176632    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg79v\" (UniqueName: \"kubernetes.io/projected/20819726-afb7-44a7-a81c-a0e35155a5a2-kube-api-access-hg79v\") pod \"kuadrant-operator-controller-manager-55c7f4c975-gkd5f\" (UID: \"20819726-afb7-44a7-a81c-a0e35155a5a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.305184 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.305158    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.428671 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.428640    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"]
May 27 18:45:32.432228 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:45:32.432204    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20819726_afb7_44a7_a81c_a0e35155a5a2.slice/crio-1107b1918019b57088eec3521f9a9e897403ebc51723c130483f280f1f1df28a WatchSource:0}: Error finding container 1107b1918019b57088eec3521f9a9e897403ebc51723c130483f280f1f1df28a: Status 404 returned error can't find the container with id 1107b1918019b57088eec3521f9a9e897403ebc51723c130483f280f1f1df28a
May 27 18:45:32.692789 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.692686    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f" event={"ID":"20819726-afb7-44a7-a81c-a0e35155a5a2","Type":"ContainerStarted","Data":"142f72a09ff6e1079737a415b1fa94926400e250ed2964362a3b3a01e0cc6b75"}
May 27 18:45:32.692789 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.692730    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f" event={"ID":"20819726-afb7-44a7-a81c-a0e35155a5a2","Type":"ContainerStarted","Data":"1107b1918019b57088eec3521f9a9e897403ebc51723c130483f280f1f1df28a"}
May 27 18:45:32.692789 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.692749    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:45:32.693931 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.693904    2571 generic.go:358] "Generic (PLEG): container finished" podID="83629d0d-17ea-4e72-87b7-42287c855d94" containerID="9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6" exitCode=0
May 27 18:45:32.694044 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.693956    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"
May 27 18:45:32.694044 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.693957    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx" event={"ID":"83629d0d-17ea-4e72-87b7-42287c855d94","Type":"ContainerDied","Data":"9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6"}
May 27 18:45:32.694114 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.694064    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx" event={"ID":"83629d0d-17ea-4e72-87b7-42287c855d94","Type":"ContainerDied","Data":"7a80a12d01be6fdfd92a1b14f7e84e0ed655afb702693961357c60e4769fc439"}
May 27 18:45:32.694114 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.694080    2571 scope.go:117] "RemoveContainer" containerID="9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6"
May 27 18:45:32.703134 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.703119    2571 scope.go:117] "RemoveContainer" containerID="9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6"
May 27 18:45:32.703361 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:45:32.703346    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6\": container with ID starting with 9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6 not found: ID does not exist" containerID="9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6"
May 27 18:45:32.703411 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.703368    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6"} err="failed to get container status \"9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6\": rpc error: code = NotFound desc = could not find container \"9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6\": container with ID starting with 9c387acafd445d55631c6b2db276830cfeb4f482f29f9944171107671eebd2d6 not found: ID does not exist"
May 27 18:45:32.720798 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.720760    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f" podStartSLOduration=1.720746406 podStartE2EDuration="1.720746406s" podCreationTimestamp="2026-05-27 18:45:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:45:32.719638013 +0000 UTC m=+581.369860648" watchObservedRunningTime="2026-05-27 18:45:32.720746406 +0000 UTC m=+581.370969002"
May 27 18:45:32.735812 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.735785    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"]
May 27 18:45:32.740209 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:32.740187    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mlbbx"]
May 27 18:45:33.985115 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:33.985086    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83629d0d-17ea-4e72-87b7-42287c855d94" path="/var/lib/kubelet/pods/83629d0d-17ea-4e72-87b7-42287c855d94/volumes"
May 27 18:45:43.700944 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:45:43.700912    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-gkd5f"
May 27 18:46:41.623560 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.623506    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86bc7dd8bc-pgh69"]
May 27 18:46:41.625753 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.625737    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:41.628298 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.628274    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 27 18:46:41.628536 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.628505    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8vl6q\""
May 27 18:46:41.637364 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.637334    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86bc7dd8bc-pgh69"]
May 27 18:46:41.688315 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.688281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbd7\" (UniqueName: \"kubernetes.io/projected/8dfd2977-b99b-4aa3-9453-548c7fa83b2a-kube-api-access-wvbd7\") pod \"maas-controller-86bc7dd8bc-pgh69\" (UID: \"8dfd2977-b99b-4aa3-9453-548c7fa83b2a\") " pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:41.787235 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.787202    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f45b8664-jjvq5"]
May 27 18:46:41.789067 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.789035    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbd7\" (UniqueName: \"kubernetes.io/projected/8dfd2977-b99b-4aa3-9453-548c7fa83b2a-kube-api-access-wvbd7\") pod \"maas-controller-86bc7dd8bc-pgh69\" (UID: \"8dfd2977-b99b-4aa3-9453-548c7fa83b2a\") " pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:41.789621 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.789604    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:41.798450 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.798370    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbd7\" (UniqueName: \"kubernetes.io/projected/8dfd2977-b99b-4aa3-9453-548c7fa83b2a-kube-api-access-wvbd7\") pod \"maas-controller-86bc7dd8bc-pgh69\" (UID: \"8dfd2977-b99b-4aa3-9453-548c7fa83b2a\") " pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:41.800361 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.800338    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f45b8664-jjvq5"]
May 27 18:46:41.890590 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.890469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qf6h\" (UniqueName: \"kubernetes.io/projected/610aba96-b210-4998-81c9-da0859b8c127-kube-api-access-5qf6h\") pod \"maas-controller-6f45b8664-jjvq5\" (UID: \"610aba96-b210-4998-81c9-da0859b8c127\") " pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:41.938595 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.938560    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:41.991046 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:41.991012    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qf6h\" (UniqueName: \"kubernetes.io/projected/610aba96-b210-4998-81c9-da0859b8c127-kube-api-access-5qf6h\") pod \"maas-controller-6f45b8664-jjvq5\" (UID: \"610aba96-b210-4998-81c9-da0859b8c127\") " pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:42.001211 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:42.000790    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qf6h\" (UniqueName: \"kubernetes.io/projected/610aba96-b210-4998-81c9-da0859b8c127-kube-api-access-5qf6h\") pod \"maas-controller-6f45b8664-jjvq5\" (UID: \"610aba96-b210-4998-81c9-da0859b8c127\") " pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:42.071286 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:42.071253    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86bc7dd8bc-pgh69"]
May 27 18:46:42.074744 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:46:42.074701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dfd2977_b99b_4aa3_9453_548c7fa83b2a.slice/crio-e7c296983857183d7dc732b142e040ab9f5769809f7c0a72174a848da8e88016 WatchSource:0}: Error finding container e7c296983857183d7dc732b142e040ab9f5769809f7c0a72174a848da8e88016: Status 404 returned error can't find the container with id e7c296983857183d7dc732b142e040ab9f5769809f7c0a72174a848da8e88016
May 27 18:46:42.100605 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:42.100580    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:42.225573 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:42.225544    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f45b8664-jjvq5"]
May 27 18:46:42.227876 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:46:42.227848    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610aba96_b210_4998_81c9_da0859b8c127.slice/crio-f548c676cc095b305be7eded6ef197593c63d5226a785f790df28fde0abe56e8 WatchSource:0}: Error finding container f548c676cc095b305be7eded6ef197593c63d5226a785f790df28fde0abe56e8: Status 404 returned error can't find the container with id f548c676cc095b305be7eded6ef197593c63d5226a785f790df28fde0abe56e8
May 27 18:46:42.918945 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:42.918898    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f45b8664-jjvq5" event={"ID":"610aba96-b210-4998-81c9-da0859b8c127","Type":"ContainerStarted","Data":"f548c676cc095b305be7eded6ef197593c63d5226a785f790df28fde0abe56e8"}
May 27 18:46:42.921527 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:42.921484    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69" event={"ID":"8dfd2977-b99b-4aa3-9453-548c7fa83b2a","Type":"ContainerStarted","Data":"e7c296983857183d7dc732b142e040ab9f5769809f7c0a72174a848da8e88016"}
May 27 18:46:44.930085 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:44.930041    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f45b8664-jjvq5" event={"ID":"610aba96-b210-4998-81c9-da0859b8c127","Type":"ContainerStarted","Data":"2e5242c9a46eac3cc4006e4b98c3b81f5856e5f630cdbed2d7f1624c1ef053e5"}
May 27 18:46:44.930603 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:44.930160    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:44.931832 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:44.931804    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69" event={"ID":"8dfd2977-b99b-4aa3-9453-548c7fa83b2a","Type":"ContainerStarted","Data":"400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb"}
May 27 18:46:44.932016 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:44.931961    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:44.955271 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:44.955214    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6f45b8664-jjvq5" podStartSLOduration=1.412624288 podStartE2EDuration="3.95519649s" podCreationTimestamp="2026-05-27 18:46:41 +0000 UTC" firstStartedPulling="2026-05-27 18:46:42.229189332 +0000 UTC m=+650.879411910" lastFinishedPulling="2026-05-27 18:46:44.771761538 +0000 UTC m=+653.421984112" observedRunningTime="2026-05-27 18:46:44.954361082 +0000 UTC m=+653.604583679" watchObservedRunningTime="2026-05-27 18:46:44.95519649 +0000 UTC m=+653.605419086"
May 27 18:46:44.979932 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:44.979876    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69" podStartSLOduration=1.274044301 podStartE2EDuration="3.979861146s" podCreationTimestamp="2026-05-27 18:46:41 +0000 UTC" firstStartedPulling="2026-05-27 18:46:42.076027083 +0000 UTC m=+650.726249659" lastFinishedPulling="2026-05-27 18:46:44.78184393 +0000 UTC m=+653.432066504" observedRunningTime="2026-05-27 18:46:44.977131417 +0000 UTC m=+653.627354015" watchObservedRunningTime="2026-05-27 18:46:44.979861146 +0000 UTC m=+653.630083743"
May 27 18:46:55.940953 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:55.940917    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:55.941329 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:55.940973    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f45b8664-jjvq5"
May 27 18:46:56.005939 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.005905    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86bc7dd8bc-pgh69"]
May 27 18:46:56.006163 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.006118    2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69" podUID="8dfd2977-b99b-4aa3-9453-548c7fa83b2a" containerName="manager" containerID="cri-o://400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb" gracePeriod=30
May 27 18:46:56.248859 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.248836    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:56.309325 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.309293    2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvbd7\" (UniqueName: \"kubernetes.io/projected/8dfd2977-b99b-4aa3-9453-548c7fa83b2a-kube-api-access-wvbd7\") pod \"8dfd2977-b99b-4aa3-9453-548c7fa83b2a\" (UID: \"8dfd2977-b99b-4aa3-9453-548c7fa83b2a\") "
May 27 18:46:56.311496 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.311464    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dfd2977-b99b-4aa3-9453-548c7fa83b2a-kube-api-access-wvbd7" (OuterVolumeSpecName: "kube-api-access-wvbd7") pod "8dfd2977-b99b-4aa3-9453-548c7fa83b2a" (UID: "8dfd2977-b99b-4aa3-9453-548c7fa83b2a"). InnerVolumeSpecName "kube-api-access-wvbd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 18:46:56.410678 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.410639    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvbd7\" (UniqueName: \"kubernetes.io/projected/8dfd2977-b99b-4aa3-9453-548c7fa83b2a-kube-api-access-wvbd7\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\""
May 27 18:46:56.974163 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.974125    2571 generic.go:358] "Generic (PLEG): container finished" podID="8dfd2977-b99b-4aa3-9453-548c7fa83b2a" containerID="400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb" exitCode=0
May 27 18:46:56.974658 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.974191    2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69"
May 27 18:46:56.974658 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.974209    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69" event={"ID":"8dfd2977-b99b-4aa3-9453-548c7fa83b2a","Type":"ContainerDied","Data":"400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb"}
May 27 18:46:56.974658 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.974251    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86bc7dd8bc-pgh69" event={"ID":"8dfd2977-b99b-4aa3-9453-548c7fa83b2a","Type":"ContainerDied","Data":"e7c296983857183d7dc732b142e040ab9f5769809f7c0a72174a848da8e88016"}
May 27 18:46:56.974658 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.974267    2571 scope.go:117] "RemoveContainer" containerID="400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb"
May 27 18:46:56.983578 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.983564    2571 scope.go:117] "RemoveContainer" containerID="400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb"
May 27 18:46:56.983835 ip-10-0-142-149 kubenswrapper[2571]: E0527 18:46:56.983813    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb\": container with ID starting with 400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb not found: ID does not exist" containerID="400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb"
May 27 18:46:56.983898 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.983845    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb"} err="failed to get container status \"400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb\": rpc error: code = NotFound desc = could not find container \"400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb\": container with ID starting with 400142b255aade64a3ed185263ec403bd4b65d49cdae7bd1bed4f4210c6165cb not found: ID does not exist"
May 27 18:46:56.997253 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:56.997231    2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86bc7dd8bc-pgh69"]
May 27 18:46:57.001151 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:57.001133    2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86bc7dd8bc-pgh69"]
May 27 18:46:57.984591 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:46:57.984558    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dfd2977-b99b-4aa3-9453-548c7fa83b2a" path="/var/lib/kubelet/pods/8dfd2977-b99b-4aa3-9453-548c7fa83b2a/volumes"
May 27 18:47:14.232401 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.232363    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-58959585fc-hbm92"]
May 27 18:47:14.232901 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.232705    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dfd2977-b99b-4aa3-9453-548c7fa83b2a" containerName="manager"
May 27 18:47:14.232901 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.232718    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dfd2977-b99b-4aa3-9453-548c7fa83b2a" containerName="manager"
May 27 18:47:14.232901 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.232781    2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dfd2977-b99b-4aa3-9453-548c7fa83b2a" containerName="manager"
May 27 18:47:14.235579 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.235561    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.238056 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.238031    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 27 18:47:14.238206 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.238142    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xctgk\""
May 27 18:47:14.246641 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.246614    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58959585fc-hbm92"]
May 27 18:47:14.366865 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.366831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dn2b\" (UniqueName: \"kubernetes.io/projected/8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75-kube-api-access-4dn2b\") pod \"maas-api-58959585fc-hbm92\" (UID: \"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75\") " pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.367033 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.366877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75-maas-api-tls\") pod \"maas-api-58959585fc-hbm92\" (UID: \"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75\") " pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.468175 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.468144    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dn2b\" (UniqueName: \"kubernetes.io/projected/8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75-kube-api-access-4dn2b\") pod \"maas-api-58959585fc-hbm92\" (UID: \"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75\") " pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.468336 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.468192    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75-maas-api-tls\") pod \"maas-api-58959585fc-hbm92\" (UID: \"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75\") " pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.470666 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.470634    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75-maas-api-tls\") pod \"maas-api-58959585fc-hbm92\" (UID: \"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75\") " pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.476906 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.476883    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dn2b\" (UniqueName: \"kubernetes.io/projected/8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75-kube-api-access-4dn2b\") pod \"maas-api-58959585fc-hbm92\" (UID: \"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75\") " pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.546417 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.546380    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:14.677859 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:14.677834    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58959585fc-hbm92"]
May 27 18:47:14.679884 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:47:14.679855    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8bf2c1_1f2b_4662_8fbf_ecaaf53b6b75.slice/crio-ef8294dccc9c81cee2cac7cd621d62fddafcc3c79571818901b542da35fd92fa WatchSource:0}: Error finding container ef8294dccc9c81cee2cac7cd621d62fddafcc3c79571818901b542da35fd92fa: Status 404 returned error can't find the container with id ef8294dccc9c81cee2cac7cd621d62fddafcc3c79571818901b542da35fd92fa
May 27 18:47:15.030421 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:15.030384    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58959585fc-hbm92" event={"ID":"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75","Type":"ContainerStarted","Data":"ef8294dccc9c81cee2cac7cd621d62fddafcc3c79571818901b542da35fd92fa"}
May 27 18:47:17.044077 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:17.044037    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58959585fc-hbm92" event={"ID":"8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75","Type":"ContainerStarted","Data":"654d6b67d3b2cb124b3c3587bee3d7cb7a14f378167a26a9ef63defdcf6f13c3"}
May 27 18:47:17.044442 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:17.044156    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:17.068252 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:17.068208    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-58959585fc-hbm92" podStartSLOduration=1.131170045 podStartE2EDuration="3.068196316s" podCreationTimestamp="2026-05-27 18:47:14 +0000 UTC" firstStartedPulling="2026-05-27 18:47:14.681215882 +0000 UTC m=+683.331438458" lastFinishedPulling="2026-05-27 18:47:16.618242151 +0000 UTC m=+685.268464729" observedRunningTime="2026-05-27 18:47:17.066424019 +0000 UTC m=+685.716646615" watchObservedRunningTime="2026-05-27 18:47:17.068196316 +0000 UTC m=+685.718418941"
May 27 18:47:23.053129 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:23.053101    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-58959585fc-hbm92"
May 27 18:47:35.346362 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.346320    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"]
May 27 18:47:35.350320 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.350296    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.353625 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.353598    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 27 18:47:35.354794 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.354771    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 27 18:47:35.354912 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.354772    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 27 18:47:35.354912 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.354814    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5h7zc\""
May 27 18:47:35.363192 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.363169    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"]
May 27 18:47:35.422022 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.421984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.422182 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.422058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.422182 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.422082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.422182 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.422110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlx7\" (UniqueName: \"kubernetes.io/projected/3147ee5c-5a50-478c-8ee3-89050e1bd992-kube-api-access-6wlx7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.422283 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.422173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3147ee5c-5a50-478c-8ee3-89050e1bd992-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.422283 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.422207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523469 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523435    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523480    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlx7\" (UniqueName: \"kubernetes.io/projected/3147ee5c-5a50-478c-8ee3-89050e1bd992-kube-api-access-6wlx7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523541    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3147ee5c-5a50-478c-8ee3-89050e1bd992-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523564    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523596    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523653    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.523944 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523927    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.524010 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.523920    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.524116 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.524095    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.526030 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.526009    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3147ee5c-5a50-478c-8ee3-89050e1bd992-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.526186 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.526168    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3147ee5c-5a50-478c-8ee3-89050e1bd992-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.531413 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.531391    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlx7\" (UniqueName: \"kubernetes.io/projected/3147ee5c-5a50-478c-8ee3-89050e1bd992-kube-api-access-6wlx7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb\" (UID: \"3147ee5c-5a50-478c-8ee3-89050e1bd992\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.659268 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.659184    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:35.797759 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.797730    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"]
May 27 18:47:35.800414 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:47:35.800378    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3147ee5c_5a50_478c_8ee3_89050e1bd992.slice/crio-8bbaa3832800ceca5a4852266db8af0cc316cf066f1802e25e3b5b983b918b44 WatchSource:0}: Error finding container 8bbaa3832800ceca5a4852266db8af0cc316cf066f1802e25e3b5b983b918b44: Status 404 returned error can't find the container with id 8bbaa3832800ceca5a4852266db8af0cc316cf066f1802e25e3b5b983b918b44
May 27 18:47:35.802187 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:35.802164    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 18:47:36.107029 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:36.106995    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb" event={"ID":"3147ee5c-5a50-478c-8ee3-89050e1bd992","Type":"ContainerStarted","Data":"8bbaa3832800ceca5a4852266db8af0cc316cf066f1802e25e3b5b983b918b44"}
May 27 18:47:41.133954 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:41.133909    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb" event={"ID":"3147ee5c-5a50-478c-8ee3-89050e1bd992","Type":"ContainerStarted","Data":"46974b1a5197359e22aa18327aac975cf671d731ef3702e07ae64e19349c5378"}
May 27 18:47:46.333265 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.333164    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"]
May 27 18:47:46.336745 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.336720    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.339395 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.339354    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 27 18:47:46.346254 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.346214    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"]
May 27 18:47:46.424078 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.424031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.424078 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.424076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.424266 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.424116    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5f7z\" (UniqueName: \"kubernetes.io/projected/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-kube-api-access-w5f7z\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.424266 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.424159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.424266 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.424178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.424266 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.424200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.525372 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525326    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.525372 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525367    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.525729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525411    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5f7z\" (UniqueName: \"kubernetes.io/projected/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-kube-api-access-w5f7z\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.525729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525455    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.525729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525478    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.525729 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525503    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.526796 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525846    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.526796 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.525944    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.526796 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.526034    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.527852 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.527828    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.528208 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.528188    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.534455 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.534424    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5f7z\" (UniqueName: \"kubernetes.io/projected/d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec-kube-api-access-w5f7z\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp\" (UID: \"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.651913 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.651754    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:46.814663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:46.814632    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"]
May 27 18:47:46.817695 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:47:46.817665    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74ce9ef_b427_4d9b_80c0_5ac2ed77cdec.slice/crio-8f9642abc7735640445e7a3a2eb6a7bdfa51d2f1db0d94aba87508a875b40696 WatchSource:0}: Error finding container 8f9642abc7735640445e7a3a2eb6a7bdfa51d2f1db0d94aba87508a875b40696: Status 404 returned error can't find the container with id 8f9642abc7735640445e7a3a2eb6a7bdfa51d2f1db0d94aba87508a875b40696
May 27 18:47:47.158226 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:47.158186    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp" event={"ID":"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec","Type":"ContainerStarted","Data":"9ce76049953831a03d5837813b5b29bff5d3c5d7b2a235f4190713782a84f1af"}
May 27 18:47:47.158226 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:47.158225    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp" event={"ID":"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec","Type":"ContainerStarted","Data":"8f9642abc7735640445e7a3a2eb6a7bdfa51d2f1db0d94aba87508a875b40696"}
May 27 18:47:50.170894 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:50.170856    2571 generic.go:358] "Generic (PLEG): container finished" podID="3147ee5c-5a50-478c-8ee3-89050e1bd992" containerID="46974b1a5197359e22aa18327aac975cf671d731ef3702e07ae64e19349c5378" exitCode=0
May 27 18:47:50.171373 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:50.170925    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb" event={"ID":"3147ee5c-5a50-478c-8ee3-89050e1bd992","Type":"ContainerDied","Data":"46974b1a5197359e22aa18327aac975cf671d731ef3702e07ae64e19349c5378"}
May 27 18:47:52.178919 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:52.178842    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb" event={"ID":"3147ee5c-5a50-478c-8ee3-89050e1bd992","Type":"ContainerStarted","Data":"beb4094d21c3cc1ee52cf53e240718b6c62c13a63f5414998417b1a20539cad1"}
May 27 18:47:52.179312 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:52.179044    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:47:52.203963 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:52.203894    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb" podStartSLOduration=1.562256605 podStartE2EDuration="17.203882635s" podCreationTimestamp="2026-05-27 18:47:35 +0000 UTC" firstStartedPulling="2026-05-27 18:47:35.802358449 +0000 UTC m=+704.452581037" lastFinishedPulling="2026-05-27 18:47:51.443984488 +0000 UTC m=+720.094207067" observedRunningTime="2026-05-27 18:47:52.202692931 +0000 UTC m=+720.852915552" watchObservedRunningTime="2026-05-27 18:47:52.203882635 +0000 UTC m=+720.854105230"
May 27 18:47:53.183859 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:53.183807    2571 generic.go:358] "Generic (PLEG): container finished" podID="d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec" containerID="9ce76049953831a03d5837813b5b29bff5d3c5d7b2a235f4190713782a84f1af" exitCode=0
May 27 18:47:53.184398 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:53.184364    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp" event={"ID":"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec","Type":"ContainerDied","Data":"9ce76049953831a03d5837813b5b29bff5d3c5d7b2a235f4190713782a84f1af"}
May 27 18:47:54.190428 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:54.190389    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp" event={"ID":"d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec","Type":"ContainerStarted","Data":"caae9b0cb68a1fc1bc77b686aa61573e264d472b897f47f48f3cc0ee04d897f3"}
May 27 18:47:54.191142 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:54.191116    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:47:54.214391 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:47:54.214333    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp" podStartSLOduration=8.015346311 podStartE2EDuration="8.214315044s" podCreationTimestamp="2026-05-27 18:47:46 +0000 UTC" firstStartedPulling="2026-05-27 18:47:53.185159041 +0000 UTC m=+721.835381619" lastFinishedPulling="2026-05-27 18:47:53.384127774 +0000 UTC m=+722.034350352" observedRunningTime="2026-05-27 18:47:54.21131466 +0000 UTC m=+722.861537270" watchObservedRunningTime="2026-05-27 18:47:54.214315044 +0000 UTC m=+722.864537640"
May 27 18:48:03.201161 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:03.201131    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb"
May 27 18:48:05.207549 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:05.207504    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp"
May 27 18:48:24.246433 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.246390    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"]
May 27 18:48:24.250009 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.249992    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.255274 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.255248    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 27 18:48:24.261801 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.261779    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"]
May 27 18:48:24.265535 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.265487    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.265646 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.265553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.265646 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.265585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.265646 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.265616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.265841 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.265677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krt5q\" (UniqueName: \"kubernetes.io/projected/44ddbd4b-3f6c-4f23-8820-74a9025587ef-kube-api-access-krt5q\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.265841 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.265730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ddbd4b-3f6c-4f23-8820-74a9025587ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.366663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.366626    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.366663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.366670    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.366874 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.366695    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.366874 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.366715    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.366874 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.366738    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krt5q\" (UniqueName: \"kubernetes.io/projected/44ddbd4b-3f6c-4f23-8820-74a9025587ef-kube-api-access-krt5q\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.366874 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.366772    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ddbd4b-3f6c-4f23-8820-74a9025587ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.367154 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.367129    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.367154 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.367150    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.367274 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.367197    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.368986 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.368964    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44ddbd4b-3f6c-4f23-8820-74a9025587ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.369229 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.369214    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ddbd4b-3f6c-4f23-8820-74a9025587ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.377947 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.377928    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krt5q\" (UniqueName: \"kubernetes.io/projected/44ddbd4b-3f6c-4f23-8820-74a9025587ef-kube-api-access-krt5q\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh\" (UID: \"44ddbd4b-3f6c-4f23-8820-74a9025587ef\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.561285 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.561192    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:24.697935 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:24.697904    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"]
May 27 18:48:24.700254 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:48:24.700227    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ddbd4b_3f6c_4f23_8820_74a9025587ef.slice/crio-ff22cb27ced331a600452712448b8e012311e404887f7dd64c20e6445c5912a7 WatchSource:0}: Error finding container ff22cb27ced331a600452712448b8e012311e404887f7dd64c20e6445c5912a7: Status 404 returned error can't find the container with id ff22cb27ced331a600452712448b8e012311e404887f7dd64c20e6445c5912a7
May 27 18:48:25.297178 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:25.297133    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh" event={"ID":"44ddbd4b-3f6c-4f23-8820-74a9025587ef","Type":"ContainerStarted","Data":"86167de20fff78dc2b4e64d79ec2b3d2b46dbf080a7a1706149826e3d72f5878"}
May 27 18:48:25.297604 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:25.297185    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh" event={"ID":"44ddbd4b-3f6c-4f23-8820-74a9025587ef","Type":"ContainerStarted","Data":"ff22cb27ced331a600452712448b8e012311e404887f7dd64c20e6445c5912a7"}
May 27 18:48:31.321293 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:31.321254    2571 generic.go:358] "Generic (PLEG): container finished" podID="44ddbd4b-3f6c-4f23-8820-74a9025587ef" containerID="86167de20fff78dc2b4e64d79ec2b3d2b46dbf080a7a1706149826e3d72f5878" exitCode=0
May 27 18:48:31.321787 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:31.321329    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh" event={"ID":"44ddbd4b-3f6c-4f23-8820-74a9025587ef","Type":"ContainerDied","Data":"86167de20fff78dc2b4e64d79ec2b3d2b46dbf080a7a1706149826e3d72f5878"}
May 27 18:48:32.327393 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:32.327358    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh" event={"ID":"44ddbd4b-3f6c-4f23-8820-74a9025587ef","Type":"ContainerStarted","Data":"fb1b37363fe916ed40162ace76f5b3a6e5223252dcde2128ec1446c33f51c7c3"}
May 27 18:48:32.327817 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:32.327586    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:48:32.357692 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:32.356143    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh" podStartSLOduration=8.144969905 podStartE2EDuration="8.356120157s" podCreationTimestamp="2026-05-27 18:48:24 +0000 UTC" firstStartedPulling="2026-05-27 18:48:31.322083437 +0000 UTC m=+759.972306011" lastFinishedPulling="2026-05-27 18:48:31.533233689 +0000 UTC m=+760.183456263" observedRunningTime="2026-05-27 18:48:32.349039074 +0000 UTC m=+760.999261670" watchObservedRunningTime="2026-05-27 18:48:32.356120157 +0000 UTC m=+761.006342755"
May 27 18:48:43.345878 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:48:43.345847    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh"
May 27 18:50:44.078377 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:44.078300    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-ptdpc_39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c/manager/0.log"
May 27 18:50:44.194077 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:44.194048    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58959585fc-hbm92_8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75/maas-api/0.log"
May 27 18:50:44.304961 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:44.304931    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f45b8664-jjvq5_610aba96-b210-4998-81c9-da0859b8c127/manager/0.log"
May 27 18:50:44.421509 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:44.421432    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-hw57s_a85e7254-4509-4e58-8c92-534486a3c999/manager/1.log"
May 27 18:50:44.650011 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:44.649978    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd_21fde883-bdee-4d24-9aff-61cac5090838/manager/0.log"
May 27 18:50:46.265975 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:46.265944    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-6w2xx_90f352e6-9c5c-4cca-8510-766c689a73a9/manager/0.log"
May 27 18:50:46.383093 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:46.383063    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-wfg4m_4cb14f5e-6c64-4566-9331-805fee05cc78/manager/0.log"
May 27 18:50:46.722863 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:46.722787    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-gkd5f_20819726-afb7-44a7-a81c-a0e35155a5a2/manager/0.log"
May 27 18:50:47.403674 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:47.403641    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6f67q_a6f2477e-1e1d-400b-89c6-79f4219c7e58/discovery/0.log"
May 27 18:50:47.623663 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:47.623634    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf5b4778-xxb4p_dde5fb05-e226-445a-b5e2-b3e8ddaa11a3/kube-auth-proxy/0.log"
May 27 18:50:48.307055 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:48.307026    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh_44ddbd4b-3f6c-4f23-8820-74a9025587ef/storage-initializer/0.log"
May 27 18:50:48.314829 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:48.314805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-pnsnh_44ddbd4b-3f6c-4f23-8820-74a9025587ef/main/0.log"
May 27 18:50:48.424824 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:48.424797    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp_d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec/storage-initializer/0.log"
May 27 18:50:48.432509 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:48.432486    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s2kcp_d74ce9ef-b427-4d9b-80c0-5ac2ed77cdec/main/0.log"
May 27 18:50:48.910581 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:48.910554    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb_3147ee5c-5a50-478c-8ee3-89050e1bd992/storage-initializer/0.log"
May 27 18:50:48.920444 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:48.920422    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-cdjgb_3147ee5c-5a50-478c-8ee3-89050e1bd992/main/0.log"
May 27 18:50:56.224185 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:56.224155    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bjlvl_59104cfc-293e-409b-9366-bbd2b5b991c5/global-pull-secret-syncer/0.log"
May 27 18:50:56.378572 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:56.378530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdkth_5ee794a5-97c8-4c3f-8d8e-2d59bdb4287f/konnectivity-agent/0.log"
May 27 18:50:56.454750 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:50:56.454715    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-149.ec2.internal_f048757d5dff142454cfd857a7c0883d/haproxy/0.log"
May 27 18:51:00.713070 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:00.713041    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-6w2xx_90f352e6-9c5c-4cca-8510-766c689a73a9/manager/0.log"
May 27 18:51:00.742827 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:00.742799    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-wfg4m_4cb14f5e-6c64-4566-9331-805fee05cc78/manager/0.log"
May 27 18:51:00.853035 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:00.853004    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-gkd5f_20819726-afb7-44a7-a81c-a0e35155a5a2/manager/0.log"
May 27 18:51:02.868190 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:02.868164    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-26zf4_881d0167-3d13-4db8-b4ea-7d968140adf7/node-exporter/0.log"
May 27 18:51:02.891909 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:02.891883    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-26zf4_881d0167-3d13-4db8-b4ea-7d968140adf7/kube-rbac-proxy/0.log"
May 27 18:51:02.917352 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:02.917325    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-26zf4_881d0167-3d13-4db8-b4ea-7d968140adf7/init-textfile/0.log"
May 27 18:51:04.761590 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.761555    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-kpdqs_8976770f-c3d9-467c-84da-c3ef195a9979/networking-console-plugin/0.log"
May 27 18:51:04.962373 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.962333    2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"]
May 27 18:51:04.968019 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.968002    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:04.973302 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.973271    2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xfprs\"/\"default-dockercfg-dp7jr\""
May 27 18:51:04.976259 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.976230    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xfprs\"/\"openshift-service-ca.crt\""
May 27 18:51:04.976649 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.976631    2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xfprs\"/\"kube-root-ca.crt\""
May 27 18:51:04.981763 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:04.981736    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"]
May 27 18:51:05.069906 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.069815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-sys\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.069906 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.069891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-podres\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.070139 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.069929    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-lib-modules\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.070139 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.069947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2gc\" (UniqueName: \"kubernetes.io/projected/8a26c72f-66ba-46d0-a1eb-427046838b86-kube-api-access-hz2gc\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.070139 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.070072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-proc\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171136 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171096    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-sys\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171160    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-podres\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171238    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-sys\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171265    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-lib-modules\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171288    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-podres\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171304    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2gc\" (UniqueName: \"kubernetes.io/projected/8a26c72f-66ba-46d0-a1eb-427046838b86-kube-api-access-hz2gc\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171617 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171352    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-lib-modules\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171617 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171364    2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-proc\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.171617 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.171453    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a26c72f-66ba-46d0-a1eb-427046838b86-proc\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.180167 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.180148    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2gc\" (UniqueName: \"kubernetes.io/projected/8a26c72f-66ba-46d0-a1eb-427046838b86-kube-api-access-hz2gc\") pod \"perf-node-gather-daemonset-kdsv5\" (UID: \"8a26c72f-66ba-46d0-a1eb-427046838b86\") " pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.282332 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.282298    2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.416350 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.416317    2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"]
May 27 18:51:05.419717 ip-10-0-142-149 kubenswrapper[2571]: W0527 18:51:05.419686    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a26c72f_66ba_46d0_a1eb_427046838b86.slice/crio-861138913eb4528a81d058dbc631f90fb774d1b2639254c9069bc2ef6c8216fc WatchSource:0}: Error finding container 861138913eb4528a81d058dbc631f90fb774d1b2639254c9069bc2ef6c8216fc: Status 404 returned error can't find the container with id 861138913eb4528a81d058dbc631f90fb774d1b2639254c9069bc2ef6c8216fc
May 27 18:51:05.858855 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.858814    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5" event={"ID":"8a26c72f-66ba-46d0-a1eb-427046838b86","Type":"ContainerStarted","Data":"43b53ef52623709b98d60828a6fd83f695fe9249192dd78b087ed1372344e038"}
May 27 18:51:05.858855 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.858854    2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5" event={"ID":"8a26c72f-66ba-46d0-a1eb-427046838b86","Type":"ContainerStarted","Data":"861138913eb4528a81d058dbc631f90fb774d1b2639254c9069bc2ef6c8216fc"}
May 27 18:51:05.859279 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.858897    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:05.876210 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:05.876159    2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5" podStartSLOduration=1.8761424199999999 podStartE2EDuration="1.87614242s" podCreationTimestamp="2026-05-27 18:51:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 18:51:05.875478998 +0000 UTC m=+914.525701583" watchObservedRunningTime="2026-05-27 18:51:05.87614242 +0000 UTC m=+914.526365007"
May 27 18:51:07.422442 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:07.422408    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5ncc7_71d7939d-6e88-4f72-8362-f9d3eccaa35a/dns/0.log"
May 27 18:51:07.446628 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:07.446601    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5ncc7_71d7939d-6e88-4f72-8362-f9d3eccaa35a/kube-rbac-proxy/0.log"
May 27 18:51:07.565666 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:07.565632    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grtqd_4edbe929-ca0b-4043-ac0e-76cdbf902714/dns-node-resolver/0.log"
May 27 18:51:08.098531 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:08.098502    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2lngs_d94df2f4-b39d-4f3c-a26d-8f99aeba0382/node-ca/0.log"
May 27 18:51:09.046251 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:09.046222    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6f67q_a6f2477e-1e1d-400b-89c6-79f4219c7e58/discovery/0.log"
May 27 18:51:09.095355 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:09.095321    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf5b4778-xxb4p_dde5fb05-e226-445a-b5e2-b3e8ddaa11a3/kube-auth-proxy/0.log"
May 27 18:51:09.782664 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:09.782634    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7t5z9_1df81cd4-4462-4c8d-a818-9975a78616d9/serve-healthcheck-canary/0.log"
May 27 18:51:10.271917 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:10.271891    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsc57_88ba61a2-4051-4b37-854d-ecc40960308b/kube-rbac-proxy/0.log"
May 27 18:51:10.294469 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:10.294442    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsc57_88ba61a2-4051-4b37-854d-ecc40960308b/exporter/0.log"
May 27 18:51:10.317927 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:10.317898    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsc57_88ba61a2-4051-4b37-854d-ecc40960308b/extractor/0.log"
May 27 18:51:11.871811 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:11.871783    2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xfprs/perf-node-gather-daemonset-kdsv5"
May 27 18:51:12.409008 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:12.408982    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-ptdpc_39cedbed-cb8d-41f1-a12f-2f6ca1e3fc2c/manager/0.log"
May 27 18:51:12.431574 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:12.431544    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58959585fc-hbm92_8a8bf2c1-1f2b-4662-8fbf-ecaaf53b6b75/maas-api/0.log"
May 27 18:51:12.460453 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:12.460428    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f45b8664-jjvq5_610aba96-b210-4998-81c9-da0859b8c127/manager/0.log"
May 27 18:51:12.483607 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:12.483572    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-hw57s_a85e7254-4509-4e58-8c92-534486a3c999/manager/0.log"
May 27 18:51:12.494791 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:12.494767    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-hw57s_a85e7254-4509-4e58-8c92-534486a3c999/manager/1.log"
May 27 18:51:12.543360 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:12.543334    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bdcb4b57b-kmcwd_21fde883-bdee-4d24-9aff-61cac5090838/manager/0.log"
May 27 18:51:20.351914 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.351883    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/kube-multus-additional-cni-plugins/0.log"
May 27 18:51:20.393556 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.393527    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/egress-router-binary-copy/0.log"
May 27 18:51:20.495401 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.495371    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/cni-plugins/0.log"
May 27 18:51:20.600310 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.600279    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/bond-cni-plugin/0.log"
May 27 18:51:20.633122 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.633046    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/routeoverride-cni/0.log"
May 27 18:51:20.661630 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.661605    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/whereabouts-cni-bincopy/0.log"
May 27 18:51:20.684870 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:20.684838    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqr27_720134c5-5c97-4281-b0df-ddc63fef983b/whereabouts-cni/0.log"
May 27 18:51:21.129836 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:21.129803    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-stftg_209d6a60-9132-4510-a33a-039144b387df/kube-multus/0.log"
May 27 18:51:21.284319 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:21.284285    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6fb5_3d7fbf16-8394-4c75-ac14-50fae454a40b/network-metrics-daemon/0.log"
May 27 18:51:21.307394 ip-10-0-142-149 kubenswrapper[2571]: I0527 18:51:21.307361    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6fb5_3d7fbf16-8394-4c75-ac14-50fae454a40b/kube-rbac-proxy/0.log"