Jun 07 16:01:47.301210 ip-10-0-142-162 systemd[1]: Starting Kubernetes Kubelet... Jun 07 16:01:47.709192 ip-10-0-142-162 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:01:47.709192 ip-10-0-142-162 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 16:01:47.709192 ip-10-0-142-162 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:01:47.709192 ip-10-0-142-162 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 16:01:47.709192 ip-10-0-142-162 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:01:47.711169 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.711024 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 16:01:47.715148 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715130 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:47.715148 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715147 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715151 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715154 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715157 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715160 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715162 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715170 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715174 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715176 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715179 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715181 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715184 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715186 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715189 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715191 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715194 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715196 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715199 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715201 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:47.715215 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715204 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715206 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715209 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715212 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715214 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715217 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715220 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715222 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715225 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715228 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715231 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715234 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715236 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715238 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715241 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715244 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715246 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715250 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715255 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715258 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:47.715658 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715260 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715263 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715265 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715267 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715270 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715273 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715277 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715280 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715283 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715285 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715288 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715290 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715292 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715295 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715298 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715301 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715304 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715307 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715311 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:47.716186 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715314 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715317 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715320 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715322 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715325 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715327 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715330 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715332 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715335 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715337 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715339 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715342 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715345 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715348 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715351 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715353 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715356 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715358 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715362 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715364 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:47.716661 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715367 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715371 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715374 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715377 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715380 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715382 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715385 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715389 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715392 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715394 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715398 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715400 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715403 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715406 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715408 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715411 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715413 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715415 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715418 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.715421 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:47.717172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716177 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716184 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716187 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716190 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716193 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716197 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716199 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716202 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716206 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716209 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716211 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716214 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716217 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716219 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716222 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716225 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716228 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716230 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716233 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716237 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:47.717655 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716240 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716242 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716246 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716251 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716254 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716257 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716260 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716263 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716265 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716268 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716270 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716273 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716275 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716278 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716280 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716283 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716285 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716288 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716291 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716294 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:47.718172 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716297 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716299 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716303 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716307 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716310 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716313 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716316 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716318 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716321 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716324 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716327 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716332 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716335 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716337 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716340 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716343 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716346 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716348 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716351 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:47.718672 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716354 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716357 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716359 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716362 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716364 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716367 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716370 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716373 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716376 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716378 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716381 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716384 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716388 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716392 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716395 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716398 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716400 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716404 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716407 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:47.719158 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716409 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716412 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716415 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716417 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716420 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716424 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716427 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716429 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716432 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716434 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716437 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716440 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716442 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716445 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716447 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716450 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716452 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716456 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716458 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716461 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:47.719608 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716463 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716918 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716925 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716928 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716931 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716934 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716948 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716952 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716956 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716960 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716963 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716966 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716970 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716973 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716976 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716978 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716981 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716984 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716987 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716990 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:47.720135 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716992 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716995 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.716998 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717000 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717003 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717006 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717009 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717011 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717014 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717016 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717019 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717022 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717024 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717027 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717029 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717033 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717037 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717040 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717043 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:47.720643 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717045 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717048 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717050 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717053 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717055 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717058 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717061 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717064 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717066 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717069 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717072 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717075 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717077 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717080 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717083 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717085 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717088 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717090 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717093 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717096 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:47.721126 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717098 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717100 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717103 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717105 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717108 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717110 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717112 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717115 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717118 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717120 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717124 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717127 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717130 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717136 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717138 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717141 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717144 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717147 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717150 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717152 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:47.721636 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717155 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717157 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717163 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717166 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717169 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717171 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717174 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717177 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717179 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717182 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717185 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717187 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717190 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717193 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717197 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717200 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717203 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717206 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717208 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:47.722151 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717211 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717213 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717282 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717290 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717296 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717301 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717310 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717314 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717320 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717326 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717331 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717334 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717338 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717341 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717345 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717350 2572 flags.go:64] FLAG: --cgroup-root="" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717353 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717356 2572 flags.go:64] FLAG: --client-ca-file="" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717359 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717362 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717367 2572 flags.go:64] FLAG: --cluster-domain="" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717370 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717373 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717376 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 16:01:47.722647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717379 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717383 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717387 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717390 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717393 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717396 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717399 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717402 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717405 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717408 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717412 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717415 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717418 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717421 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717426 2572 flags.go:64] FLAG: --enable-server="true" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717430 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717435 2572 flags.go:64] FLAG: --event-burst="100" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717438 2572 flags.go:64] FLAG: --event-qps="50" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717441 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717444 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717447 2572 flags.go:64] FLAG: --eviction-hard="" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717450 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717453 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717458 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717461 2572 flags.go:64] FLAG: --eviction-soft="" Jun 07 16:01:47.723243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717464 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717467 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717470 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717473 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717476 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717479 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717482 2572 flags.go:64] FLAG: --feature-gates="" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717486 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717489 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717492 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717495 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717498 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717501 2572 flags.go:64] FLAG: --help="false" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717504 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-142-162.ec2.internal" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717507 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717511 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717513 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717517 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717520 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717523 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717526 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717530 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717533 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 16:01:47.723848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717536 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717540 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717542 2572 flags.go:64] FLAG: --kube-reserved="" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717545 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717548 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717551 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717554 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717558 2572 flags.go:64] FLAG: --lock-file="" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717561 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717564 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717567 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717573 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717575 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717578 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717581 2572 flags.go:64] FLAG: --logging-format="text" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717584 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717587 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717590 2572 flags.go:64] FLAG: --manifest-url="" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717593 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717598 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717601 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717605 2572 flags.go:64] FLAG: --max-pods="110" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717608 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717611 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717613 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 16:01:47.724478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717616 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717619 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717622 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717626 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717634 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717639 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717641 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717644 2572 flags.go:64] FLAG: --pod-cidr="" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717648 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717653 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717656 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717660 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717663 2572 flags.go:64] FLAG: --port="10250" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717666 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717669 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-096a91662ceb25bb6" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717673 2572 flags.go:64] FLAG: --qos-reserved="" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717676 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717679 2572 flags.go:64] FLAG: --register-node="true" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717682 2572 flags.go:64] FLAG: --register-with-taints="" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717686 2572 flags.go:64] FLAG: --registry-burst="10" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717689 2572 flags.go:64] FLAG: --registry-qps="5" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717691 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717694 2572 flags.go:64] FLAG: --reserved-memory="" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717698 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717701 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 16:01:47.725213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717704 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717706 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717709 2572 flags.go:64] FLAG: --runonce="false" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717712 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717715 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717718 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717721 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717724 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717727 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717730 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717733 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717736 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717740 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717743 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717745 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717748 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717754 2572 flags.go:64] FLAG: --system-cgroups="" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717757 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717762 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717765 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717768 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717773 2572 flags.go:64] FLAG: --tls-min-version="" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717776 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717779 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717782 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 16:01:47.725859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717785 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717788 2572 flags.go:64] FLAG: --v="2" Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717792 2572 flags.go:64] FLAG: --version="false" Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717796 2572 flags.go:64] FLAG: --vmodule="" Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717800 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.717803 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717948 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717953 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717956 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717959 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717962 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717964 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717967 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717969 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717972 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717975 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717978 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717981 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717983 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717986 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717989 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:47.726471 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717992 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717994 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.717997 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718001 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718005 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718008 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718011 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718013 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718016 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718019 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718021 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718024 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718026 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718029 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718031 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718034 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718036 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718039 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718041 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718044 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:47.726991 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718047 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718050 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718053 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718055 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718057 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718060 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718062 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718065 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718067 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718070 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718073 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718076 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718078 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718081 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718083 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718085 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718089 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718091 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718094 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718096 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:47.727453 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718099 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718101 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718104 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718106 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718109 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718111 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718114 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718116 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718119 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718121 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718124 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718126 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718130 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718133 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718136 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718138 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718141 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718143 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718146 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:47.728015 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718149 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718153 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718155 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718158 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718161 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718164 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718166 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718169 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718172 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718175 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718178 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718181 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718184 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718188 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718191 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718193 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718196 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718199 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718201 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718204 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:47.728466 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718206 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718209 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718211 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718214 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.718217 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.718869 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.726248 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.726264 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.726283 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.726290 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726346 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726351 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726354 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726357 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726360 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:47.728984 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726363 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726366 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726368 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726371 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726374 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726376 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726379 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726381 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726384 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726387 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726390 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726392 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726395 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726397 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726400 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726402 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726405 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726408 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726410 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726412 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:47.729353 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726415 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726417 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726420 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726422 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726426 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726429 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726432 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726434 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726437 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726439 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726442 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726444 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726447 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726450 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726452 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726455 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726458 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726460 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726463 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726465 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726468 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:47.729833 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726470 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726473 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726476 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726479 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726481 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726484 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726486 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726489 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726491 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726494 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726496 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726499 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726502 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726504 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726507 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726511 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726514 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726516 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726519 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726521 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:47.730358 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726524 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726526 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726529 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726531 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726534 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726537 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726539 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726541 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726544 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726546 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726551 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726554 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726557 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726560 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726563 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726566 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726568 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726573 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726576 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:47.730846 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726579 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726582 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726585 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726587 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726590 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726592 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726595 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726598 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726613 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726618 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726622 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726625 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726629 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726631 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:47.731313 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.726636 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726752 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726757 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726760 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726763 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726766 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726768 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726771 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726774 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726777 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726780 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726782 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726785 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726787 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726790 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726792 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726795 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726798 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726800 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726803 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:01:47.731651 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726805 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726808 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726810 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726813 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726815 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726818 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726820 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726839 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726843 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726847 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726851 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726855 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726858 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726861 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726864 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726866 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726869 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726872 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726874 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726876 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:01:47.732224 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726879 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726881 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726884 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726887 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726889 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726892 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726894 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726897 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726900 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726902 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726905 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726909 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726912 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726915 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726918 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726921 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726923 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726926 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726929 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726931 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:01:47.732691 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726934 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726936 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726940 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726942 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726945 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726947 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726950 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726952 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726955 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726957 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726960 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726962 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726965 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726967 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726970 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726972 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726975 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726977 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726979 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726982 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:01:47.733234 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726985 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726988 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726990 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726993 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726996 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.726999 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727001 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727004 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727006 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727009 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727013 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727016 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727019 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727022 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727025 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727030 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727033 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727036 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727039 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:01:47.733709 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:47.727041 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.727046 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.727163 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.729443 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.731132 2572 server.go:1019] "Starting client certificate rotation" Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.731240 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.732043 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:01:47.734194 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.734091 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:01:47.741160 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.741136 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:01:47.754222 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.754201 2572 log.go:25] "Validated CRI v1 runtime API" Jun 07 16:01:47.757357 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.757340 2572 log.go:25] "Validated CRI v1 image API" Jun 07 16:01:47.758217 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.758198 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 16:01:47.761879 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.761859 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 827e0403-1f96-43c9-be33-85fd8f6fa144:/dev/nvme0n1p3 9cde1475-48dc-43af-ab33-348794fafef1:/dev/nvme0n1p4] Jun 07 16:01:47.761951 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.761878 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 16:01:47.762822 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.762806 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:01:47.767588 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.767453 2572 manager.go:216] Machine: {Timestamp:2026-06-07 16:01:47.766173662 +0000 UTC m=+0.352012067 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099530 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d73971cff18c317a0ee97dd5843d SystemUUID:ec21d739-71cf-f18c-317a-0ee97dd5843d BootID:5edc665a-4c73-4163-9cde-5d7ad463d275 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:5d:ab:b2:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:5d:ab:b2:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:6e:dd:da:f4:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 16:01:47.767588 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.767587 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 16:01:47.767682 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.767668 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 16:01:47.771306 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.771271 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 16:01:47.771463 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.771308 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 16:01:47.772191 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.772179 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 16:01:47.772226 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.772194 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 16:01:47.772226 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.772204 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:01:47.773143 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.773129 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:01:47.774574 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.774560 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 16:01:47.778994 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.778976 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:01:47.779147 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779136 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 16:01:47.779179 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779171 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 07 16:01:47.779206 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779187 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 16:01:47.779206 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779204 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 16:01:47.779284 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779215 2572 kubelet.go:398] "Adding apiserver pod source" Jun 07 16:01:47.779284 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779225 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 16:01:47.779623 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779597 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:01:47.779670 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.779633 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:01:47.782331 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.782310 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 16:01:47.784212 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.784197 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 16:01:47.784264 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.784230 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 16:01:47.785713 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785701 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785717 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785724 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785729 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785737 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785743 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785751 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 16:01:47.785755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785757 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 16:01:47.786048 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785764 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 16:01:47.786048 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785770 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 16:01:47.786048 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785779 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 16:01:47.786048 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.785784 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 16:01:47.786634 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.786624 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 16:01:47.786634 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.786633 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 16:01:47.789693 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.789678 2572 server.go:1268] "Started kubelet" Jun 07 16:01:47.789869 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.789785 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 16:01:47.789994 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.789892 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 16:01:47.793299 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.789852 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 16:01:47.793374 ip-10-0-142-162 systemd[1]: Started Kubernetes Kubelet. Jun 07 16:01:47.793997 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.793581 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 16:01:47.793997 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.793845 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 16:01:47.794545 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.794515 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 16:01:47.794618 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.794515 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 16:01:47.796806 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.796748 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 07 16:01:47.797545 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.797523 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 16:01:47.799307 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.798229 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-162.ec2.internal.18b6d7eb2fba8162 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-162.ec2.internal,UID:ip-10-0-142-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-162.ec2.internal,},FirstTimestamp:2026-06-07 16:01:47.789648226 +0000 UTC m=+0.375486633,LastTimestamp:2026-06-07 16:01:47.789648226 +0000 UTC m=+0.375486633,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-162.ec2.internal,}" Jun 07 16:01:47.803660 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.803630 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 16:01:47.803730 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.803634 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 16:01:47.804186 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.803865 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:47.804657 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.804478 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 16:01:47.804714 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.804698 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 16:01:47.804714 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.804713 2572 factory.go:55] Registering systemd factory Jun 07 16:01:47.804848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.804721 2572 factory.go:223] Registration of the systemd container factory successfully Jun 07 16:01:47.804848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.804819 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 16:01:47.804937 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.804849 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 16:01:47.805043 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805021 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 07 16:01:47.805043 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805034 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 07 16:01:47.805163 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805142 2572 factory.go:153] Registering CRI-O factory Jun 07 16:01:47.805163 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805162 2572 factory.go:223] Registration of the crio container factory successfully Jun 07 16:01:47.805320 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805187 2572 factory.go:103] Registering Raw factory Jun 07 16:01:47.805320 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805201 2572 manager.go:1196] Started watching for new ooms in manager Jun 07 16:01:47.805652 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.805635 2572 manager.go:349] Starting recovery of all containers Jun 07 16:01:47.805877 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.805854 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 07 16:01:47.806001 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.805956 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 07 16:01:47.807195 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.807172 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hb9n" Jun 07 16:01:47.814371 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.814349 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hb9n" Jun 07 16:01:47.816368 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.816300 2572 manager.go:354] Recovery completed Jun 07 16:01:47.820450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.820435 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.822332 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.822316 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.822384 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.822347 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.822384 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.822358 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:47.823006 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.822990 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 16:01:47.823006 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.823007 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 16:01:47.823117 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.822996 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.823117 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.823023 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:01:47.824158 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.824139 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.824223 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.824177 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.824223 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.824189 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:47.824905 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.824894 2572 policy_none.go:49] "None policy: Start" Jun 07 16:01:47.824941 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.824909 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 16:01:47.824941 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.824920 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 16:01:47.826585 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.826568 2572 policy_none.go:47] "Start" Jun 07 16:01:47.858599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.858426 2572 manager.go:337] "Starting Device Plugin manager" Jun 07 16:01:47.858698 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.858628 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 16:01:47.858698 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.858642 2572 server.go:87] "Starting device plugin registration server" Jun 07 16:01:47.858939 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.858920 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 16:01:47.859004 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.858939 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 16:01:47.859075 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.859054 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 16:01:47.859148 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.859132 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 16:01:47.859148 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.859143 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 16:01:47.860924 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.860901 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 16:01:47.861014 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.860959 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:47.877374 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.877348 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 16:01:47.889271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.878767 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 16:01:47.889271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.878806 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 16:01:47.889271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.878848 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 16:01:47.889271 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.878888 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 16:01:47.889271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.880852 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:47.959969 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.959876 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.961009 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.960990 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.961104 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.961019 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.961104 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.961030 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:47.961104 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.961059 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-162.ec2.internal" Jun 07 16:01:47.968529 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.968514 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-162.ec2.internal" Jun 07 16:01:47.968573 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:47.968536 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-162.ec2.internal\": node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:47.979509 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.979488 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal"] Jun 07 16:01:47.979621 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.979550 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.980410 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.980397 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.980459 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.980431 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.980459 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.980446 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:47.982761 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.982737 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.982904 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.982848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" Jun 07 16:01:47.982904 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.982876 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.983659 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.983643 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.983729 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.983670 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.983729 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.983670 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.983729 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.983681 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:47.983729 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.983696 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.983729 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.983706 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:47.985703 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.985687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:47.985790 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.985713 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:01:47.986411 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.986397 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:01:47.986508 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.986426 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:01:47.986508 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:47.986441 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:01:48.006018 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.005983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92b0d35ab8ab1eceed4098a9c3cb9653-config\") pod \"kube-apiserver-proxy-ip-10-0-142-162.ec2.internal\" (UID: \"92b0d35ab8ab1eceed4098a9c3cb9653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.006018 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.006018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56c94195262c4e2972e3650d9bd89583-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"56c94195262c4e2972e3650d9bd89583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.006223 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.006036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56c94195262c4e2972e3650d9bd89583-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"56c94195262c4e2972e3650d9bd89583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.011869 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.011850 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-162.ec2.internal\" not found" node="ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.016542 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.016521 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-162.ec2.internal\" not found" node="ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.018542 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.018522 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.106174 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.106140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92b0d35ab8ab1eceed4098a9c3cb9653-config\") pod \"kube-apiserver-proxy-ip-10-0-142-162.ec2.internal\" (UID: \"92b0d35ab8ab1eceed4098a9c3cb9653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.106174 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.106172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56c94195262c4e2972e3650d9bd89583-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"56c94195262c4e2972e3650d9bd89583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.106375 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.106193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56c94195262c4e2972e3650d9bd89583-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"56c94195262c4e2972e3650d9bd89583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.106375 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.106242 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92b0d35ab8ab1eceed4098a9c3cb9653-config\") pod \"kube-apiserver-proxy-ip-10-0-142-162.ec2.internal\" (UID: \"92b0d35ab8ab1eceed4098a9c3cb9653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.106375 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.106292 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56c94195262c4e2972e3650d9bd89583-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"56c94195262c4e2972e3650d9bd89583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.106375 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.106316 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56c94195262c4e2972e3650d9bd89583-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal\" (UID: \"56c94195262c4e2972e3650d9bd89583\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.119301 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.119272 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.220112 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.220047 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.317936 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.317897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.320720 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.320704 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.323624 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.323305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:48.421650 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.421609 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.522128 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.522056 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.622661 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.622633 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.723207 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.723170 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.730359 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.730330 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 16:01:48.730519 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.730493 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:01:48.818149 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.818069 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 15:56:47 +0000 UTC" deadline="2027-11-28 18:03:37.814150113 +0000 UTC" Jun 07 16:01:48.818149 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.818100 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12938h1m48.996053161s" Jun 07 16:01:48.824245 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.824224 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:48.872621 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.872593 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:48.887512 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:48.887482 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c94195262c4e2972e3650d9bd89583.slice/crio-13b8e27a39f1abc64e35e3b8db94f3b802afaba1779660e1238fa45180f661b2 WatchSource:0}: Error finding container 13b8e27a39f1abc64e35e3b8db94f3b802afaba1779660e1238fa45180f661b2: Status 404 returned error can't find the container with id 13b8e27a39f1abc64e35e3b8db94f3b802afaba1779660e1238fa45180f661b2 Jun 07 16:01:48.887874 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:48.887856 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b0d35ab8ab1eceed4098a9c3cb9653.slice/crio-4d61290f90b0192ac70eb63dfd081ea10ed5ad9aab006a82f6af63c8ef1a9a9c WatchSource:0}: Error finding container 4d61290f90b0192ac70eb63dfd081ea10ed5ad9aab006a82f6af63c8ef1a9a9c: Status 404 returned error can't find the container with id 4d61290f90b0192ac70eb63dfd081ea10ed5ad9aab006a82f6af63c8ef1a9a9c Jun 07 16:01:48.893024 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:48.893007 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:01:48.925010 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:48.924969 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:49.025528 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.025493 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:49.126072 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.126001 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:49.226658 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.226603 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-162.ec2.internal\" not found" Jun 07 16:01:49.309629 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.309597 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:49.355500 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.355468 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:49.404583 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.404504 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" Jun 07 16:01:49.412893 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.412870 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:01:49.414137 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.414113 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" Jun 07 16:01:49.426107 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.426086 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:01:49.780093 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.779989 2572 apiserver.go:52] "Watching apiserver" Jun 07 16:01:49.789985 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.789955 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 16:01:49.790318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.790296 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-htzzp","openshift-ovn-kubernetes/ovnkube-node-w5z2h","kube-system/global-pull-secret-syncer-qcd4m","kube-system/konnectivity-agent-4csj6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz","openshift-dns/node-resolver-5v7b2","openshift-image-registry/node-ca-mslzn","openshift-multus/multus-additional-cni-plugins-f4jk9","openshift-multus/multus-m9zmw","openshift-network-diagnostics/network-check-target-jfxj2","kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal","openshift-cluster-node-tuning-operator/tuned-455v6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal","openshift-multus/network-metrics-daemon-sdppg"] Jun 07 16:01:49.792886 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.792861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:49.793001 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.792953 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:01:49.795328 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.795290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.797522 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.797498 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 16:01:49.797872 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.797730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fn4f\"" Jun 07 16:01:49.797872 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.797760 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 16:01:49.797872 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.797782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.799394 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.798845 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.799394 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.798925 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 16:01:49.799394 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.799138 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 16:01:49.799394 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.799175 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.799751 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.799498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.800735 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.800534 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 16:01:49.800735 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.800593 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 16:01:49.801058 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.800958 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qdpkw\"" Jun 07 16:01:49.801469 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.801390 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.801572 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.801500 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.801756 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.801736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.802565 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.802545 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jwwmx\"" Jun 07 16:01:49.802653 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.802592 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 16:01:49.804033 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.803550 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.804033 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.803896 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pzbl9\"" Jun 07 16:01:49.804168 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.804066 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 16:01:49.804168 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.804125 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 16:01:49.804520 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.804257 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.804520 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.804390 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.806040 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.806020 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.806359 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.806341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.806881 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.806862 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pxff5\"" Jun 07 16:01:49.807263 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.807117 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.808432 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.808413 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.808528 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.808482 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.808893 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.808596 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-btzl6\"" Jun 07 16:01:49.808893 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.808687 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 16:01:49.809094 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.808893 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.810922 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.810903 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.812318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.811445 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 16:01:49.812318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.811486 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 16:01:49.812318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.811517 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.812318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.811759 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qlsqc\"" Jun 07 16:01:49.812318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.811891 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.812318 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.812138 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 16:01:49.813567 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.813384 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5hczk\"" Jun 07 16:01:49.813720 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.813705 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 16:01:49.814088 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.814060 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:01:49.814471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.814449 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:49.814554 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.814528 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:01:49.816894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.816875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.817322 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-cni-netd\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.817898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.817898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-ovn\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.817898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-node-log\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.817898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817751 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovn-node-metrics-cert\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.817898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a87a452-4abc-435a-af9d-9cccbf9af93e-host-slash\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.817898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-socket-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovnkube-config\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-host\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.817977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5fgn\" (UniqueName: \"kubernetes.io/projected/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-kube-api-access-g5fgn\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-kubelet\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-etc-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovnkube-script-lib\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-registration-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818186 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b02d20-dec0-4531-b44f-dc3d0fb43149-agent-certs\") pod \"konnectivity-agent-4csj6\" (UID: \"13b02d20-dec0-4531-b44f-dc3d0fb43149\") " pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-serviceca\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.818334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-run-netns\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-log-socket\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjft\" (UniqueName: \"kubernetes.io/projected/bf33094b-f6df-448d-9b80-026e3fae0ad3-kube-api-access-5vjft\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-systemd-units\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818599 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-var-lib-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-env-overrides\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxlff\" (UniqueName: \"kubernetes.io/projected/3a87a452-4abc-435a-af9d-9cccbf9af93e-kube-api-access-nxlff\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-sys-fs\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-tmp-dir\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.818982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.818800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-slash\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.819407 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a87a452-4abc-435a-af9d-9cccbf9af93e-iptables-alerter-script\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.819407 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-device-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.819407 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b02d20-dec0-4531-b44f-dc3d0fb43149-konnectivity-ca\") pod \"konnectivity-agent-4csj6\" (UID: \"13b02d20-dec0-4531-b44f-dc3d0fb43149\") " pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.819590 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-systemd\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.819660 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.819756 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twns5\" (UniqueName: \"kubernetes.io/projected/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-kube-api-access-twns5\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.819808 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819784 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-etc-selinux\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.819901 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.819842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-hosts-file\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.820042 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.820027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfsr4\" (UniqueName: \"kubernetes.io/projected/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-kube-api-access-dfsr4\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.820127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.820116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-cni-bin\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.821105 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.820284 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:49.821105 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.820403 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:01:49.821105 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.820639 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:01:49.821105 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.820777 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 16:01:49.821925 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.821671 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vmpq4\"" Jun 07 16:01:49.834314 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.834279 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w66fp" Jun 07 16:01:49.843511 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.843485 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w66fp" Jun 07 16:01:49.884055 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.883997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" event={"ID":"92b0d35ab8ab1eceed4098a9c3cb9653","Type":"ContainerStarted","Data":"4d61290f90b0192ac70eb63dfd081ea10ed5ad9aab006a82f6af63c8ef1a9a9c"} Jun 07 16:01:49.885233 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.885204 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" event={"ID":"56c94195262c4e2972e3650d9bd89583","Type":"ContainerStarted","Data":"13b8e27a39f1abc64e35e3b8db94f3b802afaba1779660e1238fa45180f661b2"} Jun 07 16:01:49.906250 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.906224 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 16:01:49.920944 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.920819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.920944 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.920885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.920944 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.920906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.920944 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.920915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-socket-dir-parent\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.920962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9msn\" (UniqueName: \"kubernetes.io/projected/93eb5e52-5377-4fa2-a51f-19556755d4c8-kube-api-access-v9msn\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-var-lib-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-env-overrides\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-sys-fs\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-os-release\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-var-lib-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-cni-multus\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.921240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-kubernetes\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921282 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-sys-fs\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-var-lib-kubelet\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-host\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-tmp-dir\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a87a452-4abc-435a-af9d-9cccbf9af93e-iptables-alerter-script\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-device-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-systemd\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twns5\" (UniqueName: \"kubernetes.io/projected/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-kube-api-access-twns5\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cnibin\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-cnibin\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.921614 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-os-release\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921625 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-env-overrides\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-cni-bin\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-system-cni-dir\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-cni-netd\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921730 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-tmp-dir\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz49x\" (UniqueName: \"kubernetes.io/projected/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-kube-api-access-gz49x\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-cni-binary-copy\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-ovn\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-cni-netd\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-node-log\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921913 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a87a452-4abc-435a-af9d-9cccbf9af93e-host-slash\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-device-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-socket-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-ovn\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.921997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-systemd\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922037 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-node-log\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.922360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-k8s-cni-cncf-io\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-cni-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a87a452-4abc-435a-af9d-9cccbf9af93e-host-slash\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922132 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-socket-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922153 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-etc-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-etc-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-registration-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysctl-d\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-serviceca\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-run-netns\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-daemon-config\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/209644e1-7cd5-44e7-8894-278589a38a88-dbus\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-lib-modules\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkcm7\" (UniqueName: \"kubernetes.io/projected/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-kube-api-access-bkcm7\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3a87a452-4abc-435a-af9d-9cccbf9af93e-iptables-alerter-script\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-systemd-units\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923178 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxlff\" (UniqueName: \"kubernetes.io/projected/3a87a452-4abc-435a-af9d-9cccbf9af93e-kube-api-access-nxlff\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-registration-dir\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922586 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-run-netns\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922588 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-run\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-slash\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922625 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-multus-certs\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922687 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-systemd-units\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.922992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/209644e1-7cd5-44e7-8894-278589a38a88-kubelet-config\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-systemd\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b02d20-dec0-4531-b44f-dc3d0fb43149-konnectivity-ca\") pod \"konnectivity-agent-4csj6\" (UID: \"13b02d20-dec0-4531-b44f-dc3d0fb43149\") " pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-serviceca\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-etc-selinux\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.923990 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-modprobe-d\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysctl-conf\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93eb5e52-5377-4fa2-a51f-19556755d4c8-tmp\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-hosts-file\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsr4\" (UniqueName: \"kubernetes.io/projected/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-kube-api-access-dfsr4\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-cni-bin\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-hostroot\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-conf-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-etc-kubernetes\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-kubelet\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f5fs\" (UniqueName: \"kubernetes.io/projected/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-kube-api-access-9f5fs\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysconfig\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovn-node-metrics-cert\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b02d20-dec0-4531-b44f-dc3d0fb43149-konnectivity-ca\") pod \"konnectivity-agent-4csj6\" (UID: \"13b02d20-dec0-4531-b44f-dc3d0fb43149\") " pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.924772 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923597 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-slash\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-hosts-file\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-system-cni-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923720 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf33094b-f6df-448d-9b80-026e3fae0ad3-etc-selinux\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-cni-bin\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923756 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-sys\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-tuned\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjft\" (UniqueName: \"kubernetes.io/projected/bf33094b-f6df-448d-9b80-026e3fae0ad3-kube-api-access-5vjft\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-run-openvswitch\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.923988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovnkube-config\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-host\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5fgn\" (UniqueName: \"kubernetes.io/projected/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-kube-api-access-g5fgn\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924034 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924063 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-kubelet\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovnkube-script-lib\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924156 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-host-kubelet\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924198 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-host\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.925599 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-netns\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:49.926456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:49.926456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b02d20-dec0-4531-b44f-dc3d0fb43149-agent-certs\") pod \"konnectivity-agent-4csj6\" (UID: \"13b02d20-dec0-4531-b44f-dc3d0fb43149\") " pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.926456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-log-socket\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.926456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-log-socket\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.926456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovnkube-config\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.926456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.924804 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovnkube-script-lib\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.928401 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.928379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-ovn-node-metrics-cert\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.928532 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.928489 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b02d20-dec0-4531-b44f-dc3d0fb43149-agent-certs\") pod \"konnectivity-agent-4csj6\" (UID: \"13b02d20-dec0-4531-b44f-dc3d0fb43149\") " pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:49.932109 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.931804 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:49.932109 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.931849 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:49.932109 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.931865 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:49.932109 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:49.931928 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:01:50.431908754 +0000 UTC m=+3.017747150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:49.934751 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.934685 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfsr4\" (UniqueName: \"kubernetes.io/projected/2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e-kube-api-access-dfsr4\") pod \"node-resolver-5v7b2\" (UID: \"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e\") " pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:49.934999 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.934981 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twns5\" (UniqueName: \"kubernetes.io/projected/a51625bd-4b6f-4bf4-8a98-0529a7f0298c-kube-api-access-twns5\") pod \"ovnkube-node-w5z2h\" (UID: \"a51625bd-4b6f-4bf4-8a98-0529a7f0298c\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:49.935066 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.935034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxlff\" (UniqueName: \"kubernetes.io/projected/3a87a452-4abc-435a-af9d-9cccbf9af93e-kube-api-access-nxlff\") pod \"iptables-alerter-htzzp\" (UID: \"3a87a452-4abc-435a-af9d-9cccbf9af93e\") " pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:49.935863 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.935841 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5fgn\" (UniqueName: \"kubernetes.io/projected/b368c86d-aaf4-41a1-9a79-a6bbe2a88807-kube-api-access-g5fgn\") pod \"node-ca-mslzn\" (UID: \"b368c86d-aaf4-41a1-9a79-a6bbe2a88807\") " pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:49.936563 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:49.936526 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjft\" (UniqueName: \"kubernetes.io/projected/bf33094b-f6df-448d-9b80-026e3fae0ad3-kube-api-access-5vjft\") pod \"aws-ebs-csi-driver-node-g54tz\" (UID: \"bf33094b-f6df-448d-9b80-026e3fae0ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:50.025635 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-system-cni-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.025805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-sys\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.025805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-tuned\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.025805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-netns\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.025805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-system-cni-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.025805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025784 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-netns\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.025805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025784 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-sys\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-socket-dir-parent\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025885 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9msn\" (UniqueName: \"kubernetes.io/projected/93eb5e52-5377-4fa2-a51f-19556755d4c8-kube-api-access-v9msn\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-os-release\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-cni-multus\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-kubernetes\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025965 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-socket-dir-parent\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.025983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-var-lib-kubelet\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026019 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-os-release\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-host\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-var-lib-kubelet\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026060 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-cni-multus\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-host\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-kubernetes\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026104 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cnibin\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-cnibin\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-os-release\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cnibin\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.026133 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-cni-bin\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-system-cni-dir\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026214 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-cnibin\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-os-release\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz49x\" (UniqueName: \"kubernetes.io/projected/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-kube-api-access-gz49x\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026247 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-cni-bin\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.026265 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:50.526244051 +0000 UTC m=+3.112082467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-system-cni-dir\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-cni-binary-copy\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-k8s-cni-cncf-io\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-cni-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysctl-d\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.026950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-k8s-cni-cncf-io\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-daemon-config\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/209644e1-7cd5-44e7-8894-278589a38a88-dbus\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-lib-modules\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkcm7\" (UniqueName: \"kubernetes.io/projected/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-kube-api-access-bkcm7\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-run\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026554 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysctl-d\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-multus-certs\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-cni-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026592 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/209644e1-7cd5-44e7-8894-278589a38a88-dbus\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026590 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-lib-modules\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/209644e1-7cd5-44e7-8894-278589a38a88-kubelet-config\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026609 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-run-multus-certs\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/209644e1-7cd5-44e7-8894-278589a38a88-kubelet-config\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026654 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-run\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.026677 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:50.027436 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.026726 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:50.526709121 +0000 UTC m=+3.112547517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-systemd\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026788 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-modprobe-d\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysctl-conf\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93eb5e52-5377-4fa2-a51f-19556755d4c8-tmp\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-hostroot\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-conf-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-etc-kubernetes\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-kubelet\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f5fs\" (UniqueName: \"kubernetes.io/projected/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-kube-api-access-9f5fs\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysconfig\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-daemon-config\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027142 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-systemd\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysconfig\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027180 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-modprobe-d\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-hostroot\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.026867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-cni-binary-copy\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027223 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-multus-conf-dir\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027265 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-etc-kubernetes\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027274 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-sysctl-conf\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027344 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027459 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-host-var-lib-kubelet\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.028780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.027726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.029088 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.028962 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93eb5e52-5377-4fa2-a51f-19556755d4c8-etc-tuned\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.029403 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.029385 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93eb5e52-5377-4fa2-a51f-19556755d4c8-tmp\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.038649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.038568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkcm7\" (UniqueName: \"kubernetes.io/projected/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-kube-api-access-bkcm7\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:50.038781 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.038744 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f5fs\" (UniqueName: \"kubernetes.io/projected/4f6ba2a5-aa60-4c73-b8ea-1c527c841030-kube-api-access-9f5fs\") pod \"multus-m9zmw\" (UID: \"4f6ba2a5-aa60-4c73-b8ea-1c527c841030\") " pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.039134 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.039114 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9msn\" (UniqueName: \"kubernetes.io/projected/93eb5e52-5377-4fa2-a51f-19556755d4c8-kube-api-access-v9msn\") pod \"tuned-455v6\" (UID: \"93eb5e52-5377-4fa2-a51f-19556755d4c8\") " pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.039259 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.039236 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz49x\" (UniqueName: \"kubernetes.io/projected/2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7-kube-api-access-gz49x\") pod \"multus-additional-cni-plugins-f4jk9\" (UID: \"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7\") " pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.108883 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.108845 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:01:50.118923 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.118896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:01:50.131831 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.131803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-htzzp" Jun 07 16:01:50.137577 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.137545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" Jun 07 16:01:50.145042 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.145018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5v7b2" Jun 07 16:01:50.151543 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.151524 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:01:50.152570 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.152545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mslzn" Jun 07 16:01:50.160081 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.160056 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" Jun 07 16:01:50.167918 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.167888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9zmw" Jun 07 16:01:50.173882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.173855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-455v6" Jun 07 16:01:50.530483 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.530407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:50.530483 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.530455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.530576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530614 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530677 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530688 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:51.530668897 +0000 UTC m=+4.116507292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530692 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530706 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530715 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530721 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:51.530707418 +0000 UTC m=+4.116545811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:50.530760 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:50.530756 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:01:51.530745324 +0000 UTC m=+4.116583719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:50.847469 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.847369 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 15:56:49 +0000 UTC" deadline="2028-02-11 21:35:42.012235234 +0000 UTC" Jun 07 16:01:50.847469 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:50.847416 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14741h33m51.164822357s" Jun 07 16:01:50.901801 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.901776 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf33094b_f6df_448d_9b80_026e3fae0ad3.slice/crio-2b5b3b292bc2fe4fc6f50d5bbcdf804461ff2c180e160f59eeac6a18ea9689f1 WatchSource:0}: Error finding container 2b5b3b292bc2fe4fc6f50d5bbcdf804461ff2c180e160f59eeac6a18ea9689f1: Status 404 returned error can't find the container with id 2b5b3b292bc2fe4fc6f50d5bbcdf804461ff2c180e160f59eeac6a18ea9689f1 Jun 07 16:01:50.902451 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.902313 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da31f98_f1cd_42e9_aa3c_7eaa6374a9a7.slice/crio-3bf459ddf13126454a18de00b125601535d369a6125ec5e08b46b353884d5051 WatchSource:0}: Error finding container 3bf459ddf13126454a18de00b125601535d369a6125ec5e08b46b353884d5051: Status 404 returned error can't find the container with id 3bf459ddf13126454a18de00b125601535d369a6125ec5e08b46b353884d5051 Jun 07 16:01:50.904461 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.904439 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6ba2a5_aa60_4c73_b8ea_1c527c841030.slice/crio-5a822a624b97f2932d63355cd69d9bd7ebf0ab695e4ed9acaa7383c895a7553b WatchSource:0}: Error finding container 5a822a624b97f2932d63355cd69d9bd7ebf0ab695e4ed9acaa7383c895a7553b: Status 404 returned error can't find the container with id 5a822a624b97f2932d63355cd69d9bd7ebf0ab695e4ed9acaa7383c895a7553b Jun 07 16:01:50.905886 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.905862 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51625bd_4b6f_4bf4_8a98_0529a7f0298c.slice/crio-e83afde2d2dcb9e7bcd3ac26ea260368a34e61519185de200cceed644008050f WatchSource:0}: Error finding container e83afde2d2dcb9e7bcd3ac26ea260368a34e61519185de200cceed644008050f: Status 404 returned error can't find the container with id e83afde2d2dcb9e7bcd3ac26ea260368a34e61519185de200cceed644008050f Jun 07 16:01:50.929163 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.929137 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93eb5e52_5377_4fa2_a51f_19556755d4c8.slice/crio-653f2b7423a99bc82fca54e13684943fd82d665e8c86a53178f0b9d07b628ecf WatchSource:0}: Error finding container 653f2b7423a99bc82fca54e13684943fd82d665e8c86a53178f0b9d07b628ecf: Status 404 returned error can't find the container with id 653f2b7423a99bc82fca54e13684943fd82d665e8c86a53178f0b9d07b628ecf Jun 07 16:01:50.931637 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.931599 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb368c86d_aaf4_41a1_9a79_a6bbe2a88807.slice/crio-d1bbf55552393ab0d5171a43aa40affba8cc640865b2ec0f9608440bc9021800 WatchSource:0}: Error finding container d1bbf55552393ab0d5171a43aa40affba8cc640865b2ec0f9608440bc9021800: Status 404 returned error can't find the container with id d1bbf55552393ab0d5171a43aa40affba8cc640865b2ec0f9608440bc9021800 Jun 07 16:01:50.932488 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.932408 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a87a452_4abc_435a_af9d_9cccbf9af93e.slice/crio-1f05676ea9f7553de5ee50143a331dafc24280245cba89805a5eb2d49f42b6ed WatchSource:0}: Error finding container 1f05676ea9f7553de5ee50143a331dafc24280245cba89805a5eb2d49f42b6ed: Status 404 returned error can't find the container with id 1f05676ea9f7553de5ee50143a331dafc24280245cba89805a5eb2d49f42b6ed Jun 07 16:01:50.934028 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.933911 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b02d20_dec0_4531_b44f_dc3d0fb43149.slice/crio-2326dd3ae63e756d4049ea0492b8a991673d55ab200d48662a8ed30cb4ab6a7c WatchSource:0}: Error finding container 2326dd3ae63e756d4049ea0492b8a991673d55ab200d48662a8ed30cb4ab6a7c: Status 404 returned error can't find the container with id 2326dd3ae63e756d4049ea0492b8a991673d55ab200d48662a8ed30cb4ab6a7c Jun 07 16:01:50.934683 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:01:50.934661 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2863b1a0_37a5_4fe7_9b2f_ee6e6e06f06e.slice/crio-ad256949c4ca12549ac5905265bb25026088b45ddd73ee0084f82a6f3b530ef0 WatchSource:0}: Error finding container ad256949c4ca12549ac5905265bb25026088b45ddd73ee0084f82a6f3b530ef0: Status 404 returned error can't find the container with id ad256949c4ca12549ac5905265bb25026088b45ddd73ee0084f82a6f3b530ef0 Jun 07 16:01:51.538577 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.538292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:51.538577 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.538570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:51.538789 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.538607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:51.538789 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.538734 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:51.538981 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.538797 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:53.538778839 +0000 UTC m=+6.124617246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:51.539236 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.539218 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:51.539322 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.539272 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:53.539256785 +0000 UTC m=+6.125095177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:51.539380 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.539349 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:51.539380 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.539367 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:51.539380 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.539378 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:51.539521 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.539412 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:01:53.539401448 +0000 UTC m=+6.125239844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:51.848485 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.848367 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 15:56:49 +0000 UTC" deadline="2028-03-20 07:19:16.914546246 +0000 UTC" Jun 07 16:01:51.848485 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.848431 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15639h17m25.066119264s" Jun 07 16:01:51.881131 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.880368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:51.881131 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.880532 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:01:51.881131 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.880974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:51.881131 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.881080 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:01:51.881674 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.881550 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:51.881674 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:51.881642 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:01:51.909081 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.909044 2572 generic.go:356] "Generic (PLEG): container finished" podID="56c94195262c4e2972e3650d9bd89583" containerID="4b8c3f053d7f20eb783bc51313b25876202145b1e6885593edabdf0b10ad69f5" exitCode=0 Jun 07 16:01:51.909251 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.909135 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" event={"ID":"56c94195262c4e2972e3650d9bd89583","Type":"ContainerDied","Data":"4b8c3f053d7f20eb783bc51313b25876202145b1e6885593edabdf0b10ad69f5"} Jun 07 16:01:51.922107 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.922075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5v7b2" event={"ID":"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e","Type":"ContainerStarted","Data":"ad256949c4ca12549ac5905265bb25026088b45ddd73ee0084f82a6f3b530ef0"} Jun 07 16:01:51.936211 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.936098 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4csj6" event={"ID":"13b02d20-dec0-4531-b44f-dc3d0fb43149","Type":"ContainerStarted","Data":"2326dd3ae63e756d4049ea0492b8a991673d55ab200d48662a8ed30cb4ab6a7c"} Jun 07 16:01:51.941916 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.941880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"e83afde2d2dcb9e7bcd3ac26ea260368a34e61519185de200cceed644008050f"} Jun 07 16:01:51.948619 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.948582 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mslzn" event={"ID":"b368c86d-aaf4-41a1-9a79-a6bbe2a88807","Type":"ContainerStarted","Data":"d1bbf55552393ab0d5171a43aa40affba8cc640865b2ec0f9608440bc9021800"} Jun 07 16:01:51.957630 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.957533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-455v6" event={"ID":"93eb5e52-5377-4fa2-a51f-19556755d4c8","Type":"ContainerStarted","Data":"653f2b7423a99bc82fca54e13684943fd82d665e8c86a53178f0b9d07b628ecf"} Jun 07 16:01:51.964120 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.964037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9zmw" event={"ID":"4f6ba2a5-aa60-4c73-b8ea-1c527c841030","Type":"ContainerStarted","Data":"5a822a624b97f2932d63355cd69d9bd7ebf0ab695e4ed9acaa7383c895a7553b"} Jun 07 16:01:51.976895 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.976861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" event={"ID":"92b0d35ab8ab1eceed4098a9c3cb9653","Type":"ContainerStarted","Data":"9186ae9e8c33bcfa755ba5a13ed2c1fd82549bed6c9e80275b7358211cc6ff0a"} Jun 07 16:01:51.984657 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.984581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htzzp" event={"ID":"3a87a452-4abc-435a-af9d-9cccbf9af93e","Type":"ContainerStarted","Data":"1f05676ea9f7553de5ee50143a331dafc24280245cba89805a5eb2d49f42b6ed"} Jun 07 16:01:51.999218 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:51.999164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerStarted","Data":"3bf459ddf13126454a18de00b125601535d369a6125ec5e08b46b353884d5051"} Jun 07 16:01:52.022940 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:52.022708 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" event={"ID":"bf33094b-f6df-448d-9b80-026e3fae0ad3","Type":"ContainerStarted","Data":"2b5b3b292bc2fe4fc6f50d5bbcdf804461ff2c180e160f59eeac6a18ea9689f1"} Jun 07 16:01:53.033743 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.033665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" event={"ID":"56c94195262c4e2972e3650d9bd89583","Type":"ContainerStarted","Data":"9225dac9dc7e9cbdb36d0bf3f7c831625a2745789518c920320102f281463812"} Jun 07 16:01:53.048479 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.047807 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-162.ec2.internal" podStartSLOduration=4.047785457 podStartE2EDuration="4.047785457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:01:51.995309053 +0000 UTC m=+4.581147469" watchObservedRunningTime="2026-06-07 16:01:53.047785457 +0000 UTC m=+5.633623872" Jun 07 16:01:53.048479 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.048014 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-162.ec2.internal" podStartSLOduration=4.048005571 podStartE2EDuration="4.048005571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:01:53.04702518 +0000 UTC m=+5.632863596" watchObservedRunningTime="2026-06-07 16:01:53.048005571 +0000 UTC m=+5.633843985" Jun 07 16:01:53.558200 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.558159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:53.558420 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.558222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:53.558420 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.558266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:53.558420 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.558394 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:53.558604 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.558454 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:57.558437776 +0000 UTC m=+10.144276169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:53.558927 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.558904 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:53.559050 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.558930 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:53.559050 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.558943 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:53.559050 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.558991 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:01:57.558975926 +0000 UTC m=+10.144814321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:53.559234 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.559052 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:53.559234 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.559085 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:01:57.559073578 +0000 UTC m=+10.144911974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:53.880021 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.879980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:53.880185 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.880108 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:01:53.880504 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.880480 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:53.880610 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.880587 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:01:53.880675 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:53.880663 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:53.880796 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:53.880760 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:01:55.879262 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:55.879213 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:55.879725 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:55.879359 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:01:55.879858 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:55.879815 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:55.879965 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:55.879944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:01:55.880153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:55.880110 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:55.880246 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:55.880214 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:01:57.594071 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:57.594023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:57.594081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:57.594138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594243 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594258 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594271 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594283 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594300 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:05.594283165 +0000 UTC m=+18.180121559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594318 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:02:05.594309005 +0000 UTC m=+18.180147402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594342 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:57.594524 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.594369 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:05.594359657 +0000 UTC m=+18.180198052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:01:57.880474 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:57.880389 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:57.880642 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:57.880492 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:57.880642 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.880494 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:01:57.880642 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.880576 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:01:57.880642 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:57.880632 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:57.880869 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:57.880745 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:01:59.880065 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:59.880027 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:01:59.880516 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:59.880085 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:01:59.880516 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:01:59.880161 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:01:59.880516 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:59.880181 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:01:59.880516 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:59.880262 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:01:59.880516 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:01:59.880372 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:01.879849 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:01.879802 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:01.879849 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:01.879835 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:01.880405 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:01.879944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:01.880405 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:01.880013 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:01.880405 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:01.880067 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:01.880405 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:01.880191 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:03.879328 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:03.879290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:03.879803 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:03.879295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:03.879803 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:03.879427 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:03.879803 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:03.879522 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:03.879803 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:03.879555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:03.879803 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:03.879651 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:05.659539 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:05.659498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:05.659557 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659677 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659701 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659727 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659740 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:05.659751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659793 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:02:21.659775669 +0000 UTC m=+34.245614075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659842 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:21.659816784 +0000 UTC m=+34.245655183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659843 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:05.660094 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.659890 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:21.659880455 +0000 UTC m=+34.245718851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:05.879705 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:05.879668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:05.879906 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:05.879668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:05.879906 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.879817 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:05.879906 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:05.879668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:05.880075 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.879944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:05.880075 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:05.880042 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:07.879669 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:07.879640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:07.880179 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:07.879749 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:07.880179 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:07.879768 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:07.880179 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:07.879771 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:07.880179 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:07.879888 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:07.880179 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:07.879984 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:09.879650 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:09.879622 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:09.880199 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:09.879622 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:09.880199 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:09.879751 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:09.880199 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:09.879853 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:09.880199 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:09.879867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:09.880199 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:09.879958 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:10.069985 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.069949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mslzn" event={"ID":"b368c86d-aaf4-41a1-9a79-a6bbe2a88807","Type":"ContainerStarted","Data":"3e36456eb7d0650eb4cba70761cd9bdee7966f5dfb3e38f25afd47e02bb4ee23"} Jun 07 16:02:10.071449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.071415 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-455v6" event={"ID":"93eb5e52-5377-4fa2-a51f-19556755d4c8","Type":"ContainerStarted","Data":"346d4ac281bfa3a1b050d8569f8ccf7df52361574b06e531541f401e61cddbb9"} Jun 07 16:02:10.076879 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.076854 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9zmw" event={"ID":"4f6ba2a5-aa60-4c73-b8ea-1c527c841030","Type":"ContainerStarted","Data":"50cd2ed9bdfd1bf48661015237e63251ca1b6cd07a1f372eae5158789c120acd"} Jun 07 16:02:10.078228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.078204 2572 generic.go:356] "Generic (PLEG): container finished" podID="2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7" containerID="17ff36f17f8e44d12b983f578d0463e9201ae3d8748dea0a895ac59e55bb2e3b" exitCode=0 Jun 07 16:02:10.078336 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.078268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerDied","Data":"17ff36f17f8e44d12b983f578d0463e9201ae3d8748dea0a895ac59e55bb2e3b"} Jun 07 16:02:10.079650 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.079626 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" event={"ID":"bf33094b-f6df-448d-9b80-026e3fae0ad3","Type":"ContainerStarted","Data":"f6680b150bdf04b98d091a7af99112461bcdeee28b9f84c62a7956cb34d68265"} Jun 07 16:02:10.081078 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.081041 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5v7b2" event={"ID":"2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e","Type":"ContainerStarted","Data":"82fe3f1e73319a25696825ff39921a951d6dff794e9652cbf0a4bcb7bc6c64e2"} Jun 07 16:02:10.082762 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.082530 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4csj6" event={"ID":"13b02d20-dec0-4531-b44f-dc3d0fb43149","Type":"ContainerStarted","Data":"12782098d9b3e78dcf9791cd62fbc04241def5167b5fd2d244dfeb070fef6d26"} Jun 07 16:02:10.084316 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.084299 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:02:10.084628 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.084609 2572 generic.go:356] "Generic (PLEG): container finished" podID="a51625bd-4b6f-4bf4-8a98-0529a7f0298c" containerID="936afb8ce093bfffb885e73641202c10fde4c0105a9a1b8b907650098becc2e7" exitCode=1 Jun 07 16:02:10.084705 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.084640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerDied","Data":"936afb8ce093bfffb885e73641202c10fde4c0105a9a1b8b907650098becc2e7"} Jun 07 16:02:10.084705 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.084701 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"c963d1d1330e13cf65c62fb9ba590146835cd7f90a742123d1043293f196aeaa"} Jun 07 16:02:10.112450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.112401 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5v7b2" podStartSLOduration=3.6680930480000002 podStartE2EDuration="22.112385438s" totalImagesPullingTime="18.44429239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:10.111932838 +0000 UTC m=+22.697771253" watchObservedRunningTime="2026-06-07 16:02:10.112385438 +0000 UTC m=+22.698223853" Jun 07 16:02:10.126579 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.126532 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-455v6" podStartSLOduration=3.66680032 podStartE2EDuration="22.126514713s" totalImagesPullingTime="18.459714393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:10.126288209 +0000 UTC m=+22.712126635" watchObservedRunningTime="2026-06-07 16:02:10.126514713 +0000 UTC m=+22.712353127" Jun 07 16:02:10.139449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.139395 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4csj6" podStartSLOduration=7.89002791 podStartE2EDuration="22.139373638s" totalImagesPullingTime="14.249345728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:10.139085741 +0000 UTC m=+22.724924168" watchObservedRunningTime="2026-06-07 16:02:10.139373638 +0000 UTC m=+22.725212054" Jun 07 16:02:10.159837 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.159640 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mslzn" podStartSLOduration=3.714441199 podStartE2EDuration="22.159623821s" totalImagesPullingTime="18.445182622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:10.159611383 +0000 UTC m=+22.745449796" watchObservedRunningTime="2026-06-07 16:02:10.159623821 +0000 UTC m=+22.745462234" Jun 07 16:02:10.905147 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:10.905105 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 16:02:11.093889 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.093796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:02:11.094380 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.094349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"9aa9a81ca270925d0bd277388edfdea9c34058959432dc20e967414951e7469f"} Jun 07 16:02:11.094483 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.094466 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"b99782179dbdbb0109edb6a1182de8a018e2bae81c5f55200dafe6de99088d51"} Jun 07 16:02:11.094543 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.094524 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"e9a9e6bdda1397167926bb2e9e3cbbef1934037b1ea907e116d4c0c9ed3d5cfa"} Jun 07 16:02:11.094612 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.094573 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"deeab617b6c0518e0733c408a3732bf9fb662af60a66de22cc2da9710a6df3a2"} Jun 07 16:02:11.095948 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.095921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-htzzp" event={"ID":"3a87a452-4abc-435a-af9d-9cccbf9af93e","Type":"ContainerStarted","Data":"e4e62996cba17a077b865ee3d9c72989a8bdd6f688005df67682043dd4d7076a"} Jun 07 16:02:11.098134 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.098106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" event={"ID":"bf33094b-f6df-448d-9b80-026e3fae0ad3","Type":"ContainerStarted","Data":"2200cd794dceb88be9b2ca5511047ee2133300e0460c58b3e491e4c53d00014f"} Jun 07 16:02:11.111134 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.111093 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-htzzp" podStartSLOduration=4.6656338680000005 podStartE2EDuration="23.11108172s" totalImagesPullingTime="18.445447852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:11.110765964 +0000 UTC m=+23.696604379" watchObservedRunningTime="2026-06-07 16:02:11.11108172 +0000 UTC m=+23.696920135" Jun 07 16:02:11.111591 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.111561 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m9zmw" podStartSLOduration=4.505579921 podStartE2EDuration="23.111551453s" totalImagesPullingTime="18.605971532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:10.18549124 +0000 UTC m=+22.771329656" watchObservedRunningTime="2026-06-07 16:02:11.111551453 +0000 UTC m=+23.697389937" Jun 07 16:02:11.870911 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.870766 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T16:02:10.905127358Z","UUID":"0cbc5122-5335-4143-a285-d3d87b7c72de","Handler":null,"Name":"","Endpoint":""} Jun 07 16:02:11.872543 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.872523 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 16:02:11.872675 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.872563 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 16:02:11.879182 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.879157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:11.879324 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.879157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:11.879324 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:11.879288 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:11.879324 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:11.879282 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:11.879479 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:11.879402 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:11.879538 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:11.879477 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:12.102106 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:12.102009 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" event={"ID":"bf33094b-f6df-448d-9b80-026e3fae0ad3","Type":"ContainerStarted","Data":"4f1831825c614b671fdd758713fc1ca25fa197f6ef14cfdd9ce83e56bb8397d7"} Jun 07 16:02:12.131691 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:12.131620 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54tz" podStartSLOduration=7.966467386 podStartE2EDuration="24.13160323s" totalImagesPullingTime="16.165135844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:12.131566243 +0000 UTC m=+24.717404667" watchObservedRunningTime="2026-06-07 16:02:12.13160323 +0000 UTC m=+24.717441643" Jun 07 16:02:13.108569 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:13.108419 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:02:13.109128 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:13.109104 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"8b1785f0f845aa29175fc50d02e8331ea7eef31ae004e0309080de71aa0adff5"} Jun 07 16:02:13.879980 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:13.879941 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:13.880172 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:13.879941 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:13.880172 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:13.880090 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:13.880172 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:13.880091 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:13.880291 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:13.880190 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:13.880291 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:13.880280 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:14.433024 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:14.432971 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:02:14.433894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:14.433863 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:02:15.113793 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:15.113767 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:02:15.114225 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:15.114209 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4csj6" Jun 07 16:02:15.880140 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:15.879960 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:15.880789 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:15.879960 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:15.880789 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:15.880221 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:15.880789 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:15.880040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:15.880789 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:15.880312 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:15.880789 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:15.880396 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:16.119435 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.119411 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:02:16.119848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.119803 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"60f2390329d4ddd6bef90a58c099edc87e2bab0d1fd76d0f164099d6d456fdfd"} Jun 07 16:02:16.120166 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.120144 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:02:16.120292 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.120253 2572 scope.go:117] "RemoveContainer" containerID="936afb8ce093bfffb885e73641202c10fde4c0105a9a1b8b907650098becc2e7" Jun 07 16:02:16.121773 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.121745 2572 generic.go:356] "Generic (PLEG): container finished" podID="2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7" containerID="3569241b5623cb062be2762f2f9db17b83b4ccb35c4257590301b3b231585873" exitCode=0 Jun 07 16:02:16.121894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.121807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerDied","Data":"3569241b5623cb062be2762f2f9db17b83b4ccb35c4257590301b3b231585873"} Jun 07 16:02:16.137932 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:16.137908 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:02:17.127051 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.127011 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerStarted","Data":"2aa774858644f0d2c255d8b96692acbe13e0cc21fb5c82812434f69d0faeae66"} Jun 07 16:02:17.131051 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.131033 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:02:17.131384 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.131356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" event={"ID":"a51625bd-4b6f-4bf4-8a98-0529a7f0298c","Type":"ContainerStarted","Data":"3688119f6509ca265a48d80849b25ba0586f05c1635175fb1dff929b95b5f6f8"} Jun 07 16:02:17.131478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.131446 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 07 16:02:17.131569 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.131545 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:02:17.146468 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.146444 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:02:17.201434 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.201398 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qcd4m"] Jun 07 16:02:17.201609 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.201523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:17.201672 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:17.201623 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:17.202151 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.202124 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfxj2"] Jun 07 16:02:17.202224 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.202211 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:17.202314 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:17.202295 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:17.202726 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.202704 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sdppg"] Jun 07 16:02:17.202846 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.202816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:17.202965 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:17.202944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:17.226857 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:17.226299 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" podStartSLOduration=11.396462823 podStartE2EDuration="30.226271811s" totalImagesPullingTime="18.829808988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:17.225868447 +0000 UTC m=+29.811706866" watchObservedRunningTime="2026-06-07 16:02:17.226271811 +0000 UTC m=+29.812110227" Jun 07 16:02:18.134947 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.134912 2572 generic.go:356] "Generic (PLEG): container finished" podID="2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7" containerID="2aa774858644f0d2c255d8b96692acbe13e0cc21fb5c82812434f69d0faeae66" exitCode=0 Jun 07 16:02:18.135405 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.134994 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerDied","Data":"2aa774858644f0d2c255d8b96692acbe13e0cc21fb5c82812434f69d0faeae66"} Jun 07 16:02:18.135405 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.135115 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 07 16:02:18.840364 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.840327 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:02:18.879967 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.879946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:18.880099 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.879946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:18.880099 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:18.880037 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:18.880181 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:18.879946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:18.880181 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:18.880111 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:18.880252 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:18.880188 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:20.144894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:20.144643 2572 generic.go:356] "Generic (PLEG): container finished" podID="2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7" containerID="6ba642daa09cf09166acbf9b7e0eedf17e69d687a3bc1689d2a8a0aadb710204" exitCode=0 Jun 07 16:02:20.144894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:20.144727 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerDied","Data":"6ba642daa09cf09166acbf9b7e0eedf17e69d687a3bc1689d2a8a0aadb710204"} Jun 07 16:02:20.159004 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:20.158961 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" podUID="a51625bd-4b6f-4bf4-8a98-0529a7f0298c" containerName="ovnkube-controller" probeResult="failure" output="" Jun 07 16:02:20.879773 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:20.879732 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:20.879773 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:20.879765 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:20.880035 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:20.879869 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:20.880035 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:20.879883 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:20.880035 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:20.879957 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:20.880035 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:20.880021 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:21.673339 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:21.673252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:21.673339 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:21.673311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:21.673355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673448 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673463 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673471 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673509 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret podName:209644e1-7cd5-44e7-8894-278589a38a88 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:53.673496669 +0000 UTC m=+66.259335062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret") pod "global-pull-secret-syncer-qcd4m" (UID: "209644e1-7cd5-44e7-8894-278589a38a88") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673538 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:53.673519847 +0000 UTC m=+66.259358246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673474 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673559 2572 projected.go:196] Error preparing data for projected volume kube-api-access-w6ctc for pod openshift-network-diagnostics/network-check-target-jfxj2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:21.674023 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:21.673597 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc podName:4826b283-0b8e-4714-b25e-78f908fd536c nodeName:}" failed. No retries permitted until 2026-06-07 16:02:53.673585064 +0000 UTC m=+66.259423471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6ctc" (UniqueName: "kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc") pod "network-check-target-jfxj2" (UID: "4826b283-0b8e-4714-b25e-78f908fd536c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:22.879299 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:22.879262 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:22.879798 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:22.879275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:22.879798 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:22.879391 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfxj2" podUID="4826b283-0b8e-4714-b25e-78f908fd536c" Jun 07 16:02:22.879798 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:22.879479 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qcd4m" podUID="209644e1-7cd5-44e7-8894-278589a38a88" Jun 07 16:02:22.879798 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:22.879262 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:22.879798 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:22.879600 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:02:23.209564 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.209523 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-162.ec2.internal" event="NodeReady" Jun 07 16:02:23.209759 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.209692 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 16:02:23.251667 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.251635 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bbd66d8bd-lv8n8"] Jun 07 16:02:23.254240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.254204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.254731 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.254543 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6"] Jun 07 16:02:23.256094 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.256070 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl"] Jun 07 16:02:23.256213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.256190 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.256983 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.256962 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2s77n\"" Jun 07 16:02:23.257426 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.257403 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 16:02:23.257505 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.257480 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 16:02:23.257669 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.257650 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 16:02:23.258132 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.258043 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s"] Jun 07 16:02:23.258210 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.258179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.259477 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.259454 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 07 16:02:23.259744 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.259727 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 07 16:02:23.260220 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.260044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.260220 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.260062 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 07 16:02:23.260935 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.260912 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rl6wp\"" Jun 07 16:02:23.261030 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.261017 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 07 16:02:23.261627 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.261606 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 07 16:02:23.261719 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.261681 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 07 16:02:23.261906 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.261817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 07 16:02:23.262438 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.262419 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 07 16:02:23.262627 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.262613 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 07 16:02:23.263150 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.262983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:23.267390 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.264858 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 16:02:23.275041 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.275019 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s"] Jun 07 16:02:23.275668 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.275273 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6"] Jun 07 16:02:23.276378 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.276357 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bbd66d8bd-lv8n8"] Jun 07 16:02:23.290414 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.290393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl"] Jun 07 16:02:23.388162 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c15c80b1-f0de-49b1-a9c4-99ecda79c757-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f74676bd4-47zn6\" (UID: \"c15c80b1-f0de-49b1-a9c4-99ecda79c757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.388353 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nldbp\" (UniqueName: \"kubernetes.io/projected/c15c80b1-f0de-49b1-a9c4-99ecda79c757-kube-api-access-nldbp\") pod \"managed-serviceaccount-addon-agent-5f74676bd4-47zn6\" (UID: \"c15c80b1-f0de-49b1-a9c4-99ecda79c757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.388353 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-trusted-ca\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388353 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-installation-pull-secrets\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388353 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-bound-sa-token\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388353 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw675\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-kube-api-access-vw675\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-image-registry-private-configuration\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-certificates\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388541 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41efb4e0-2662-44e7-a64b-f8495c68fa5b-ca-trust-extracted\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388616 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0906f640-00b5-4418-890d-71c64a74084e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtzm7\" (UniqueName: \"kubernetes.io/projected/0906f640-00b5-4418-890d-71c64a74084e-kube-api-access-rtzm7\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.388649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-ca\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.389050 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-hub\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.389050 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.389050 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.389050 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0906f640-00b5-4418-890d-71c64a74084e-tmp\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.389050 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.388799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kzkz\" (UniqueName: \"kubernetes.io/projected/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-kube-api-access-7kzkz\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.435783 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.435745 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:23.489789 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0906f640-00b5-4418-890d-71c64a74084e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489797 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtzm7\" (UniqueName: \"kubernetes.io/projected/0906f640-00b5-4418-890d-71c64a74084e-kube-api-access-rtzm7\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-ca\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489863 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-hub\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489909 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0906f640-00b5-4418-890d-71c64a74084e-tmp\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.489952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kzkz\" (UniqueName: \"kubernetes.io/projected/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-kube-api-access-7kzkz\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.490003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.490001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c15c80b1-f0de-49b1-a9c4-99ecda79c757-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f74676bd4-47zn6\" (UID: \"c15c80b1-f0de-49b1-a9c4-99ecda79c757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.490402 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.490048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nldbp\" (UniqueName: \"kubernetes.io/projected/c15c80b1-f0de-49b1-a9c4-99ecda79c757-kube-api-access-nldbp\") pod \"managed-serviceaccount-addon-agent-5f74676bd4-47zn6\" (UID: \"c15c80b1-f0de-49b1-a9c4-99ecda79c757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.490402 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.490073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-trusted-ca\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.490547 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.490516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0906f640-00b5-4418-890d-71c64a74084e-tmp\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.490872 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.490771 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.490993 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.490872 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:23.490993 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.490888 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:23.490993 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.490946 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:02:23.990927348 +0000 UTC m=+36.576765755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:23.491157 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-trusted-ca\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.491209 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-installation-pull-secrets\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.491209 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-bound-sa-token\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.491310 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw675\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-kube-api-access-vw675\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.491310 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.491310 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-image-registry-private-configuration\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.491449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.491449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-certificates\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.491449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41efb4e0-2662-44e7-a64b-f8495c68fa5b-ca-trust-extracted\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.492121 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.491894 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41efb4e0-2662-44e7-a64b-f8495c68fa5b-ca-trust-extracted\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.492424 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.492375 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-certificates\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.495331 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.495286 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-installation-pull-secrets\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.495331 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.495319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-hub\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.495484 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.495411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c15c80b1-f0de-49b1-a9c4-99ecda79c757-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f74676bd4-47zn6\" (UID: \"c15c80b1-f0de-49b1-a9c4-99ecda79c757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.495632 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.495603 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-ca\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.496101 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.496080 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0906f640-00b5-4418-890d-71c64a74084e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.496101 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.496092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-image-registry-private-configuration\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.496853 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.496802 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.497124 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.497099 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.501311 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.501283 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtzm7\" (UniqueName: \"kubernetes.io/projected/0906f640-00b5-4418-890d-71c64a74084e-kube-api-access-rtzm7\") pod \"klusterlet-addon-workmgr-7f4b4d4b66-vxp9s\" (UID: \"0906f640-00b5-4418-890d-71c64a74084e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.504981 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.504952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nldbp\" (UniqueName: \"kubernetes.io/projected/c15c80b1-f0de-49b1-a9c4-99ecda79c757-kube-api-access-nldbp\") pod \"managed-serviceaccount-addon-agent-5f74676bd4-47zn6\" (UID: \"c15c80b1-f0de-49b1-a9c4-99ecda79c757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.505382 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.505358 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kzkz\" (UniqueName: \"kubernetes.io/projected/37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0-kube-api-access-7kzkz\") pod \"cluster-proxy-proxy-agent-c6bc7585f-trkjl\" (UID: \"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.505869 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.505782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-bound-sa-token\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.506845 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.506770 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw675\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-kube-api-access-vw675\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.507127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.507101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:23.529553 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.529524 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4q4wd"] Jun 07 16:02:23.532186 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.532162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.534344 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.534317 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 16:02:23.534451 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.534415 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g7mpp\"" Jun 07 16:02:23.534653 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.534636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 16:02:23.541839 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.541788 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4q4wd"] Jun 07 16:02:23.601490 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.601454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:02:23.608574 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.608546 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:02:23.619478 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.619449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:23.627740 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.627717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:23.651870 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.651774 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wfqct"] Jun 07 16:02:23.653444 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.653424 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.657228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.657205 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 16:02:23.657333 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.657240 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 16:02:23.657333 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.657291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h275w\"" Jun 07 16:02:23.657447 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.657354 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 16:02:23.674183 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.674151 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wfqct"] Jun 07 16:02:23.693627 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.693598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c27db2-6786-471c-8492-171dc3c290a9-tmp-dir\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.693740 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.693640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75c27db2-6786-471c-8492-171dc3c290a9-config-volume\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.693740 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.693668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6xg\" (UniqueName: \"kubernetes.io/projected/75c27db2-6786-471c-8492-171dc3c290a9-kube-api-access-db6xg\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.693740 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.693696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.768998 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.768957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:23.795081 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795044 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.795249 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1a0c468-b501-4db6-8d08-b0542d58a057-cert\") pod \"ingress-canary-wfqct\" (UID: \"a1a0c468-b501-4db6-8d08-b0542d58a057\") " pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.795249 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24254\" (UniqueName: \"kubernetes.io/projected/a1a0c468-b501-4db6-8d08-b0542d58a057-kube-api-access-24254\") pod \"ingress-canary-wfqct\" (UID: \"a1a0c468-b501-4db6-8d08-b0542d58a057\") " pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.795249 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.795206 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:23.795417 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795257 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c27db2-6786-471c-8492-171dc3c290a9-tmp-dir\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.795417 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.795282 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:24.295260907 +0000 UTC m=+36.881099300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:23.795417 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75c27db2-6786-471c-8492-171dc3c290a9-config-volume\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.795417 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6xg\" (UniqueName: \"kubernetes.io/projected/75c27db2-6786-471c-8492-171dc3c290a9-kube-api-access-db6xg\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.795686 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.795666 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c27db2-6786-471c-8492-171dc3c290a9-tmp-dir\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.796024 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.796003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75c27db2-6786-471c-8492-171dc3c290a9-config-volume\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.805550 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.805523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6xg\" (UniqueName: \"kubernetes.io/projected/75c27db2-6786-471c-8492-171dc3c290a9-kube-api-access-db6xg\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:23.895862 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.895814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1a0c468-b501-4db6-8d08-b0542d58a057-cert\") pod \"ingress-canary-wfqct\" (UID: \"a1a0c468-b501-4db6-8d08-b0542d58a057\") " pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.896389 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.895880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24254\" (UniqueName: \"kubernetes.io/projected/a1a0c468-b501-4db6-8d08-b0542d58a057-kube-api-access-24254\") pod \"ingress-canary-wfqct\" (UID: \"a1a0c468-b501-4db6-8d08-b0542d58a057\") " pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.898759 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.898708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1a0c468-b501-4db6-8d08-b0542d58a057-cert\") pod \"ingress-canary-wfqct\" (UID: \"a1a0c468-b501-4db6-8d08-b0542d58a057\") " pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.903992 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.903921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24254\" (UniqueName: \"kubernetes.io/projected/a1a0c468-b501-4db6-8d08-b0542d58a057-kube-api-access-24254\") pod \"ingress-canary-wfqct\" (UID: \"a1a0c468-b501-4db6-8d08-b0542d58a057\") " pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.963729 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.963699 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wfqct" Jun 07 16:02:23.996890 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:23.996861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:23.997033 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.996971 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:23.997033 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.996983 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:23.997127 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:23.997035 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:02:24.997020333 +0000 UTC m=+37.582858726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:24.187386 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.187065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:24.270874 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.270155 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wfqct"] Jun 07 16:02:24.270874 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.270288 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s"] Jun 07 16:02:24.271436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.271416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6"] Jun 07 16:02:24.274371 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.274341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:24.275051 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:02:24.275025 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a0c468_b501_4db6_8d08_b0542d58a057.slice/crio-bdb1338c3c830cd1e787d2b3c8e86edb512a590e85390ee259f2da7aa1c532d8 WatchSource:0}: Error finding container bdb1338c3c830cd1e787d2b3c8e86edb512a590e85390ee259f2da7aa1c532d8: Status 404 returned error can't find the container with id bdb1338c3c830cd1e787d2b3c8e86edb512a590e85390ee259f2da7aa1c532d8 Jun 07 16:02:24.276022 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:02:24.275995 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0906f640_00b5_4418_890d_71c64a74084e.slice/crio-44f1e06fe8a9396c50e917814038c9e1a2c18e3b6ace414527e495572a012e12 WatchSource:0}: Error finding container 44f1e06fe8a9396c50e917814038c9e1a2c18e3b6ace414527e495572a012e12: Status 404 returned error can't find the container with id 44f1e06fe8a9396c50e917814038c9e1a2c18e3b6ace414527e495572a012e12 Jun 07 16:02:24.296027 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.295995 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl"] Jun 07 16:02:24.299759 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.299730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:24.299884 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:02:24.299807 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc15c80b1_f0de_49b1_a9c4_99ecda79c757.slice/crio-830c4c04cfaf46247528c3f5067731c890f2d26c163130f524c239c1897d83eb WatchSource:0}: Error finding container 830c4c04cfaf46247528c3f5067731c890f2d26c163130f524c239c1897d83eb: Status 404 returned error can't find the container with id 830c4c04cfaf46247528c3f5067731c890f2d26c163130f524c239c1897d83eb Jun 07 16:02:24.299936 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:24.299914 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:24.300007 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:24.299995 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.299973474 +0000 UTC m=+37.885811922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:24.300638 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:02:24.300621 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37d7edd0_c9ff_4fac_b783_67bb6ce9ebf0.slice/crio-b7b09e356fe51f6ba23bd4f814e2b0c3cf6fe795667b73e4155d08b65a91b9b0 WatchSource:0}: Error finding container b7b09e356fe51f6ba23bd4f814e2b0c3cf6fe795667b73e4155d08b65a91b9b0: Status 404 returned error can't find the container with id b7b09e356fe51f6ba23bd4f814e2b0c3cf6fe795667b73e4155d08b65a91b9b0 Jun 07 16:02:24.587847 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.587802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:24.654384 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.654347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:24.879289 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.879179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:24.879795 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.879187 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:24.879795 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.879200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:24.882018 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.881917 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.882018 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.881966 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:02:24.882189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.882075 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k5ngp\"" Jun 07 16:02:24.882189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.882089 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:02:24.882189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.882181 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hch6\"" Jun 07 16:02:24.882345 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:24.882281 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:02:25.004634 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.004595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:25.005336 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:25.004789 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:25.005336 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:25.004810 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:25.005336 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:25.004888 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:02:27.004869237 +0000 UTC m=+39.590707641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:25.174249 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.172886 2572 generic.go:356] "Generic (PLEG): container finished" podID="2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7" containerID="a3d4fd7691f013326d71004536f5eae1493edb01846c716f127ce4773681aaac" exitCode=0 Jun 07 16:02:25.174249 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.172976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerDied","Data":"a3d4fd7691f013326d71004536f5eae1493edb01846c716f127ce4773681aaac"} Jun 07 16:02:25.180371 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.180242 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" event={"ID":"c15c80b1-f0de-49b1-a9c4-99ecda79c757","Type":"ContainerStarted","Data":"830c4c04cfaf46247528c3f5067731c890f2d26c163130f524c239c1897d83eb"} Jun 07 16:02:25.184529 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.184496 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" event={"ID":"0906f640-00b5-4418-890d-71c64a74084e","Type":"ContainerStarted","Data":"44f1e06fe8a9396c50e917814038c9e1a2c18e3b6ace414527e495572a012e12"} Jun 07 16:02:25.190709 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.190615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" event={"ID":"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0","Type":"ContainerStarted","Data":"b7b09e356fe51f6ba23bd4f814e2b0c3cf6fe795667b73e4155d08b65a91b9b0"} Jun 07 16:02:25.198758 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.198679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wfqct" event={"ID":"a1a0c468-b501-4db6-8d08-b0542d58a057","Type":"ContainerStarted","Data":"bdb1338c3c830cd1e787d2b3c8e86edb512a590e85390ee259f2da7aa1c532d8"} Jun 07 16:02:25.310143 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.308309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:25.310143 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:25.309436 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:25.310143 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:25.309500 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:27.309479451 +0000 UTC m=+39.895317848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:25.319038 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.318985 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:25.420940 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.420890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:25.518732 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.518683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:25.785738 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.785418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:25.840678 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:25.840572 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:26.217009 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:26.216036 2572 generic.go:356] "Generic (PLEG): container finished" podID="2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7" containerID="603e2032feb3ea2d176f5816f5bd4415149b3bfa4e9ca61414886001f7897430" exitCode=0 Jun 07 16:02:26.217009 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:26.216096 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerDied","Data":"603e2032feb3ea2d176f5816f5bd4415149b3bfa4e9ca61414886001f7897430"} Jun 07 16:02:27.028617 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.028465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:27.028814 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:27.028667 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:27.028814 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:27.028685 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:27.028814 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:27.028775 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:02:31.028740107 +0000 UTC m=+43.614578499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:27.225707 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.225671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" event={"ID":"2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7","Type":"ContainerStarted","Data":"77afa9127082984c2ab90a0cd4f0a70eaa6f58739b746ba9153ae97e1d3985fa"} Jun 07 16:02:27.250029 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.249965 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f4jk9" podStartSLOduration=9.923215865 podStartE2EDuration="39.249943898s" totalImagesPullingTime="29.326728033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:27.248493349 +0000 UTC m=+39.834331785" watchObservedRunningTime="2026-06-07 16:02:27.249943898 +0000 UTC m=+39.835782315" Jun 07 16:02:27.268882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.268846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:27.331385 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.331304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:27.331518 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:27.331462 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:27.331553 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:27.331532 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:31.331512369 +0000 UTC m=+43.917350767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:27.369691 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.369593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:27.470222 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:27.470180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:30.307031 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:30.306989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:30.355256 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:30.355214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:30.807457 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:30.807398 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:30.874687 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:30.874637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:31.060703 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:31.060590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:31.060912 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:31.060775 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:31.060912 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:31.060796 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:31.060912 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:31.060883 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:02:39.060862807 +0000 UTC m=+51.646701202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:31.363329 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:31.363250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:31.363727 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:31.363438 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:31.363727 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:31.363532 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:39.363499974 +0000 UTC m=+51.949338371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:33.246912 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.246873 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wfqct" event={"ID":"a1a0c468-b501-4db6-8d08-b0542d58a057","Type":"ContainerStarted","Data":"c222a6ffc2c269f1e43d123c348722f5e8246c38506e03f03784fc08bc3388bd"} Jun 07 16:02:33.248282 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.248258 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" event={"ID":"c15c80b1-f0de-49b1-a9c4-99ecda79c757","Type":"ContainerStarted","Data":"accb28db61aa156c7e2ea5d9865f3d7cfe81ba3eb0eba7e4f4d33a65861f6a47"} Jun 07 16:02:33.249758 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.249736 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" event={"ID":"0906f640-00b5-4418-890d-71c64a74084e","Type":"ContainerStarted","Data":"506dcac451ef546ee9c15df249473e738d21591277129187b584c5aab8fb3bd7"} Jun 07 16:02:33.249973 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.249951 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:33.251799 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.251780 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:02:33.251985 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.251969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" event={"ID":"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0","Type":"ContainerStarted","Data":"971a039fe5771e39229bc0cba5c1d173b71c3eed1999a81064c4e98e0e17d01d"} Jun 07 16:02:33.252038 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.251993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" event={"ID":"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0","Type":"ContainerStarted","Data":"f2610fa001f0a4207083c2da8f2b5550b03408c764db2ceb50607af24a427892"} Jun 07 16:02:33.252038 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.252005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" event={"ID":"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0","Type":"ContainerStarted","Data":"3637386dae865ec68f3d2eca9f11c3aa2ca7d7d5ab4a2fa059e3c4fe341d5780"} Jun 07 16:02:33.261103 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.261063 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wfqct" podStartSLOduration=1.8862730989999998 podStartE2EDuration="10.26105088s" totalImagesPullingTime="8.374777781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:33.260890224 +0000 UTC m=+45.846728651" watchObservedRunningTime="2026-06-07 16:02:33.26105088 +0000 UTC m=+45.846889288" Jun 07 16:02:33.279223 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.279173 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" podStartSLOduration=22.892369869 podStartE2EDuration="31.279154749s" totalImagesPullingTime="8.38678488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:33.277680557 +0000 UTC m=+45.863518972" watchObservedRunningTime="2026-06-07 16:02:33.279154749 +0000 UTC m=+45.864993164" Jun 07 16:02:33.297461 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.297416 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" podStartSLOduration=22.949885794 podStartE2EDuration="31.297401202s" totalImagesPullingTime="8.347515408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:33.296623947 +0000 UTC m=+45.882462358" watchObservedRunningTime="2026-06-07 16:02:33.297401202 +0000 UTC m=+45.883239616" Jun 07 16:02:33.311521 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:33.311474 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" podStartSLOduration=22.906074434 podStartE2EDuration="31.311458238s" totalImagesPullingTime="8.405383804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:33.310436844 +0000 UTC m=+45.896275261" watchObservedRunningTime="2026-06-07 16:02:33.311458238 +0000 UTC m=+45.897296653" Jun 07 16:02:39.119858 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:39.119776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:39.120261 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:39.120148 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:39.120261 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:39.120161 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:39.120261 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:39.120223 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:02:55.120208815 +0000 UTC m=+67.706047208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:39.422959 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:39.422875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:39.423175 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:39.422995 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:39.423175 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:39.423046 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:55.423032713 +0000 UTC m=+68.008871106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:46.272951 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:46.272909 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:46.346168 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:46.346123 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:46.403299 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:46.403258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:47.273383 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:47.273350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:47.372890 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:47.372853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:48.217313 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:48.217283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:50.155295 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:50.155270 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5z2h" Jun 07 16:02:50.301321 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:50.301275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:50.401641 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:50.401607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:52.281975 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:52.281939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:52.382132 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:52.382093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:53.733131 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.733086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:53.733566 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.733147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:53.733566 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.733172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:02:53.735441 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.735421 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:02:53.735651 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.735638 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:02:53.735696 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.735643 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:02:53.743806 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:53.743775 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:02:53.743912 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:53.743869 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:57.743852504 +0000 UTC m=+130.329690901 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : secret "metrics-daemon-secret" not found Jun 07 16:02:53.745694 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.745672 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:02:53.747443 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.747418 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/209644e1-7cd5-44e7-8894-278589a38a88-original-pull-secret\") pod \"global-pull-secret-syncer-qcd4m\" (UID: \"209644e1-7cd5-44e7-8894-278589a38a88\") " pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:53.756747 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.756712 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ctc\" (UniqueName: \"kubernetes.io/projected/4826b283-0b8e-4714-b25e-78f908fd536c-kube-api-access-w6ctc\") pod \"network-check-target-jfxj2\" (UID: \"4826b283-0b8e-4714-b25e-78f908fd536c\") " pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:53.995735 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:53.995644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k5ngp\"" Jun 07 16:02:54.003695 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:54.003655 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:54.011872 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:54.011843 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qcd4m" Jun 07 16:02:54.139005 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:54.138975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfxj2"] Jun 07 16:02:54.144572 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:02:54.144540 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4826b283_0b8e_4714_b25e_78f908fd536c.slice/crio-b469b90eae4f192201e7b0d18921a489e96fd0b3a5eac8b1aeffd03499c7e1e2 WatchSource:0}: Error finding container b469b90eae4f192201e7b0d18921a489e96fd0b3a5eac8b1aeffd03499c7e1e2: Status 404 returned error can't find the container with id b469b90eae4f192201e7b0d18921a489e96fd0b3a5eac8b1aeffd03499c7e1e2 Jun 07 16:02:54.154124 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:54.154095 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qcd4m"] Jun 07 16:02:54.157432 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:02:54.157409 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209644e1_7cd5_44e7_8894_278589a38a88.slice/crio-08349da53f54aa23ac48f099bff26c728f4b3279d67b1f8e91cd131183a696ff WatchSource:0}: Error finding container 08349da53f54aa23ac48f099bff26c728f4b3279d67b1f8e91cd131183a696ff: Status 404 returned error can't find the container with id 08349da53f54aa23ac48f099bff26c728f4b3279d67b1f8e91cd131183a696ff Jun 07 16:02:54.310933 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:54.310808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qcd4m" event={"ID":"209644e1-7cd5-44e7-8894-278589a38a88","Type":"ContainerStarted","Data":"08349da53f54aa23ac48f099bff26c728f4b3279d67b1f8e91cd131183a696ff"} Jun 07 16:02:54.311899 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:54.311869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfxj2" event={"ID":"4826b283-0b8e-4714-b25e-78f908fd536c","Type":"ContainerStarted","Data":"b469b90eae4f192201e7b0d18921a489e96fd0b3a5eac8b1aeffd03499c7e1e2"} Jun 07 16:02:55.143129 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:55.143084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:02:55.143636 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:55.143221 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:02:55.143636 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:55.143233 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:02:55.143636 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:55.143285 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:03:27.143272056 +0000 UTC m=+99.729110448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:02:55.445181 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:55.445080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:02:55.445378 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:55.445272 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:55.445378 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:02:55.445364 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:27.445343107 +0000 UTC m=+100.031181505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:02:58.114891 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:58.114812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:58.213455 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:58.213375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:02:58.333027 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:58.332989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfxj2" event={"ID":"4826b283-0b8e-4714-b25e-78f908fd536c","Type":"ContainerStarted","Data":"f4d946aec4cbfe3457df77094c2f01b1af9004133e7e48e88d73ca70c51e3a83"} Jun 07 16:02:58.333207 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:58.333125 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:02:58.348003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:02:58.347943 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfxj2" podStartSLOduration=67.914352438 podStartE2EDuration="1m11.347923444s" totalImagesPullingTime="3.433571006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:58.34639856 +0000 UTC m=+70.932236979" watchObservedRunningTime="2026-06-07 16:02:58.347923444 +0000 UTC m=+70.933761861" Jun 07 16:03:00.340006 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:00.339970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qcd4m" event={"ID":"209644e1-7cd5-44e7-8894-278589a38a88","Type":"ContainerStarted","Data":"df9186f1bac23ca7da9b9082f1f4fb76039640055a48dcfa2721523ac360f4e1"} Jun 07 16:03:00.375156 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:00.375105 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qcd4m" podStartSLOduration=67.02501874 podStartE2EDuration="1m12.375090099s" totalImagesPullingTime="5.350071359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:00.374470599 +0000 UTC m=+72.960309015" watchObservedRunningTime="2026-06-07 16:03:00.375090099 +0000 UTC m=+72.960928514" Jun 07 16:03:02.267334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:02.267294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:03:02.357513 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:02.357477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:03:02.413583 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:02.413552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:03:24.307016 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:24.306892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:03:24.360482 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:24.360448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:03:24.412039 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:24.412000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:03:27.187206 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:27.187085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:03:27.187586 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:27.187240 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:03:27.187586 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:27.187258 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:03:27.187586 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:27.187315 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:04:31.18729799 +0000 UTC m=+163.773136398 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:03:27.489987 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:27.489926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:03:27.490183 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:27.490104 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:03:27.490246 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:27.490188 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:04:31.490167921 +0000 UTC m=+164.076006313 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:03:29.338781 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:29.338750 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfxj2" Jun 07 16:03:57.819437 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:03:57.819403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:03:57.819972 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:57.819528 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:03:57.819972 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:03:57.819584 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs podName:604c1b4f-4cce-439d-9d2c-b28fb53f84c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:59.819570099 +0000 UTC m=+252.405408491 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs") pod "network-metrics-daemon-sdppg" (UID: "604c1b4f-4cce-439d-9d2c-b28fb53f84c8") : secret "metrics-daemon-secret" not found Jun 07 16:04:26.269788 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:26.269721 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" Jun 07 16:04:26.545242 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:26.545148 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4q4wd" podUID="75c27db2-6786-471c-8492-171dc3c290a9" Jun 07 16:04:26.603492 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:26.603467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4q4wd" Jun 07 16:04:26.603618 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:26.603467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:04:27.903768 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:27.903732 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sdppg" podUID="604c1b4f-4cce-439d-9d2c-b28fb53f84c8" Jun 07 16:04:31.263397 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:31.263342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:04:31.263932 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:31.263502 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:04:31.263932 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:31.263522 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bbd66d8bd-lv8n8: secret "image-registry-tls" not found Jun 07 16:04:31.263932 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:31.263583 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls podName:41efb4e0-2662-44e7-a64b-f8495c68fa5b nodeName:}" failed. No retries permitted until 2026-06-07 16:06:33.263567914 +0000 UTC m=+285.849406307 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls") pod "image-registry-7bbd66d8bd-lv8n8" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b") : secret "image-registry-tls" not found Jun 07 16:04:31.565660 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:31.565537 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:04:31.565860 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:31.565680 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:04:31.565860 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:04:31.565740 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls podName:75c27db2-6786-471c-8492-171dc3c290a9 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:33.565724433 +0000 UTC m=+286.151562826 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls") pod "dns-default-4q4wd" (UID: "75c27db2-6786-471c-8492-171dc3c290a9") : secret "dns-default-metrics-tls" not found Jun 07 16:04:33.251050 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.251001 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" podUID="0906f640-00b5-4418-890d-71c64a74084e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused" Jun 07 16:04:33.602793 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.602690 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" podUID="c15c80b1-f0de-49b1-a9c4-99ecda79c757" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/healthz\": dial tcp 10.132.0.7:8000: connect: connection refused" Jun 07 16:04:33.625512 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.625479 2572 generic.go:356] "Generic (PLEG): container finished" podID="c15c80b1-f0de-49b1-a9c4-99ecda79c757" containerID="accb28db61aa156c7e2ea5d9865f3d7cfe81ba3eb0eba7e4f4d33a65861f6a47" exitCode=255 Jun 07 16:04:33.625709 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.625559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" event={"ID":"c15c80b1-f0de-49b1-a9c4-99ecda79c757","Type":"ContainerDied","Data":"accb28db61aa156c7e2ea5d9865f3d7cfe81ba3eb0eba7e4f4d33a65861f6a47"} Jun 07 16:04:33.625954 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.625942 2572 scope.go:117] "RemoveContainer" containerID="accb28db61aa156c7e2ea5d9865f3d7cfe81ba3eb0eba7e4f4d33a65861f6a47" Jun 07 16:04:33.627114 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.627086 2572 generic.go:356] "Generic (PLEG): container finished" podID="0906f640-00b5-4418-890d-71c64a74084e" containerID="506dcac451ef546ee9c15df249473e738d21591277129187b584c5aab8fb3bd7" exitCode=1 Jun 07 16:04:33.627225 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.627154 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" event={"ID":"0906f640-00b5-4418-890d-71c64a74084e","Type":"ContainerDied","Data":"506dcac451ef546ee9c15df249473e738d21591277129187b584c5aab8fb3bd7"} Jun 07 16:04:33.627482 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.627468 2572 scope.go:117] "RemoveContainer" containerID="506dcac451ef546ee9c15df249473e738d21591277129187b584c5aab8fb3bd7" Jun 07 16:04:33.627940 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:33.627861 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:04:34.632263 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:34.632230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" event={"ID":"c15c80b1-f0de-49b1-a9c4-99ecda79c757","Type":"ContainerStarted","Data":"32677b65749b9d5d8a163aeed5226704e6c236b6c5f693a0b34ef33b42a28a7a"} Jun 07 16:04:34.634015 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:34.633993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" event={"ID":"0906f640-00b5-4418-890d-71c64a74084e","Type":"ContainerStarted","Data":"83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7"} Jun 07 16:04:34.634166 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:34.634152 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:04:34.635125 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:34.635101 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:04:39.879391 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:04:39.879309 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:05:34.311163 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:34.311135 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:34.394026 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:34.393982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:36.692745 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:36.692712 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:36.743298 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:36.743227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.052753 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.052722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.153754 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.153724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.354509 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.354434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.454077 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.454048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.553452 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.553427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.742459 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.742423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:39.841522 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:39.841479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:40.105386 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:40.105307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:40.204060 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:40.204032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:40.740785 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:40.740754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:40.792002 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:40.791976 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:41.054046 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:41.053969 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5v7b2_2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e/dns-node-resolver/0.log" Jun 07 16:05:41.738560 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:41.738527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:41.789779 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:41.789745 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:42.053890 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:42.053794 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mslzn_b368c86d-aaf4-41a1-9a79-a6bbe2a88807/node-ca/0.log" Jun 07 16:05:42.578369 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:42.578338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:43.256704 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:43.256671 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wfqct_a1a0c468-b501-4db6-8d08-b0542d58a057/serve-healthcheck-canary/0.log" Jun 07 16:05:45.880973 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:45.880934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:45.981871 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:45.981822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:46.285820 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:46.285783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:46.529228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:46.529197 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:46.629721 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:46.629635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:46.730938 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:46.730905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:46.785633 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:46.785603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:47.274509 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:47.274472 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:47.883404 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:47.883374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:48.275964 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:48.275929 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:48.678261 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:48.678180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:48.880532 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:48.880499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:49.477343 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:49.477308 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:49.881381 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:49.881293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:49.980347 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:49.980313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:50.080564 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:50.080533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:50.285971 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:50.285930 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:50.485588 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:50.485555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:50.872422 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:50.872387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:51.476748 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:51.476720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:51.877286 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:51.877199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:52.275103 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:52.275070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:52.375016 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:52.374988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:52.474578 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:52.474545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:52.530118 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:52.530042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:52.877206 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:52.877118 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:53.981796 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:53.981747 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:54.084489 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:54.084464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:54.311203 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:54.311127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:54.487512 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:54.487478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:54.679781 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:54.679704 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:54.879361 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:54.879331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:55.288330 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:55.288300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:55.390667 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:55.390636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:55.880238 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:55.880206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:56.279754 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:56.279724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:56.481209 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:56.481177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:56.692687 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:56.692609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:58.652250 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:58.652217 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:58.770096 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:58.770067 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:59.153625 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.153594 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:59.365586 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.365557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:59.438078 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.437990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:59.546786 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.546754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:59.602350 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.602326 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:05:59.828724 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.828693 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:05:59.831119 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.831097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/604c1b4f-4cce-439d-9d2c-b28fb53f84c8-metrics-certs\") pod \"network-metrics-daemon-sdppg\" (UID: \"604c1b4f-4cce-439d-9d2c-b28fb53f84c8\") " pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:05:59.982171 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.982140 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hch6\"" Jun 07 16:05:59.990098 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:05:59.990080 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sdppg" Jun 07 16:06:00.011464 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.011435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:00.111627 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.111542 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sdppg"] Jun 07 16:06:00.114534 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:06:00.114505 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604c1b4f_4cce_439d_9d2c_b28fb53f84c8.slice/crio-c0a1cf64bc32b17baa000de1ebe683c1d7dc11c645ea50b959317c2dc9c80788 WatchSource:0}: Error finding container c0a1cf64bc32b17baa000de1ebe683c1d7dc11c645ea50b959317c2dc9c80788: Status 404 returned error can't find the container with id c0a1cf64bc32b17baa000de1ebe683c1d7dc11c645ea50b959317c2dc9c80788 Jun 07 16:06:00.144385 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.144357 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:00.481513 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.481487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:00.581797 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.581763 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nbqx6"] Jun 07 16:06:00.584015 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.583988 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.586709 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.586685 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 16:06:00.586888 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.586807 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 16:06:00.587757 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.587736 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8qbl\"" Jun 07 16:06:00.587757 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.587750 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 16:06:00.587950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.587794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 16:06:00.598281 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.598252 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nbqx6"] Jun 07 16:06:00.720918 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.720817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:00.738022 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.737935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6n8\" (UniqueName: \"kubernetes.io/projected/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-kube-api-access-jj6n8\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.738189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.738025 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.738189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.738079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.738189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.738175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-crio-socket\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.738369 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.738221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-data-volume\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.816583 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.816539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:00.839682 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.839652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.839693 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.839850 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-crio-socket\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.839914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-data-volume\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.839943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6n8\" (UniqueName: \"kubernetes.io/projected/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-kube-api-access-jj6n8\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.839962 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-crio-socket\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840400 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.840222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-data-volume\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.840442 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.840424 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.842284 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.842266 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.850661 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.850635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6n8\" (UniqueName: \"kubernetes.io/projected/71979a85-1d2b-4da5-97d3-cde2c7c9abb9-kube-api-access-jj6n8\") pod \"insights-runtime-extractor-nbqx6\" (UID: \"71979a85-1d2b-4da5-97d3-cde2c7c9abb9\") " pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:00.887842 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.887795 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sdppg" event={"ID":"604c1b4f-4cce-439d-9d2c-b28fb53f84c8","Type":"ContainerStarted","Data":"c0a1cf64bc32b17baa000de1ebe683c1d7dc11c645ea50b959317c2dc9c80788"} Jun 07 16:06:00.895233 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:00.895212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nbqx6" Jun 07 16:06:01.074303 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.074280 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nbqx6"] Jun 07 16:06:01.077181 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:06:01.077152 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71979a85_1d2b_4da5_97d3_cde2c7c9abb9.slice/crio-2dd78a798e5f68a573f4b6f1582017c440d34a256b25cf023a80cba51f2026aa WatchSource:0}: Error finding container 2dd78a798e5f68a573f4b6f1582017c440d34a256b25cf023a80cba51f2026aa: Status 404 returned error can't find the container with id 2dd78a798e5f68a573f4b6f1582017c440d34a256b25cf023a80cba51f2026aa Jun 07 16:06:01.359120 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.359020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:01.408026 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.407995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:01.892333 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.892242 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbqx6" event={"ID":"71979a85-1d2b-4da5-97d3-cde2c7c9abb9","Type":"ContainerStarted","Data":"746ae7c2f4c11cf485a7079a927ed74f02d2ab95e8da930b3fa8db259e7ca9b9"} Jun 07 16:06:01.892333 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.892296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbqx6" event={"ID":"71979a85-1d2b-4da5-97d3-cde2c7c9abb9","Type":"ContainerStarted","Data":"fa100e5959893b9cd4f06737bab102be31d402e01063d0396bcd180ef10eafb0"} Jun 07 16:06:01.892333 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.892322 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbqx6" event={"ID":"71979a85-1d2b-4da5-97d3-cde2c7c9abb9","Type":"ContainerStarted","Data":"2dd78a798e5f68a573f4b6f1582017c440d34a256b25cf023a80cba51f2026aa"} Jun 07 16:06:01.893927 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.893904 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sdppg" event={"ID":"604c1b4f-4cce-439d-9d2c-b28fb53f84c8","Type":"ContainerStarted","Data":"3ae025a7ae450fba0afa4ae9b6ffb2b021df767d24732bb9b1de3b99947584cf"} Jun 07 16:06:01.894023 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.893945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sdppg" event={"ID":"604c1b4f-4cce-439d-9d2c-b28fb53f84c8","Type":"ContainerStarted","Data":"97ff379ec42ed127c1ebb626a4af2e1a9d092e9f7454b60161974015dfcaa097"} Jun 07 16:06:01.910104 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.910061 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sdppg" podStartSLOduration=253.052050783 podStartE2EDuration="4m13.910047909s" totalImagesPullingTime="857.997126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:01.908624774 +0000 UTC m=+254.494463189" watchObservedRunningTime="2026-06-07 16:06:01.910047909 +0000 UTC m=+254.495886323" Jun 07 16:06:01.985714 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:01.985679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:02.086684 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:02.086654 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:03.902775 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:03.902741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbqx6" event={"ID":"71979a85-1d2b-4da5-97d3-cde2c7c9abb9","Type":"ContainerStarted","Data":"3ca5452e00b6355cc3ee096b58bc06de062b8b0e270e446777b003ddc318d66c"} Jun 07 16:06:03.919960 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:03.919912 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nbqx6" podStartSLOduration=1.9572920630000001 podStartE2EDuration="3.919896788s" totalImagesPullingTime="1.962604725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:06:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:03.91968786 +0000 UTC m=+256.505526297" watchObservedRunningTime="2026-06-07 16:06:03.919896788 +0000 UTC m=+256.505735202" Jun 07 16:06:05.810966 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:05.810928 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:05.863669 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:05.863643 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:07.832436 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:07.832348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:07.933697 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:07.933663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:09.696197 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:09.696164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:09.763034 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:09.763001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:09.849984 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:09.849953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:10.083579 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:10.083543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:10.317274 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:10.317220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:10.367405 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:10.367329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:11.569637 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:11.569606 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:11.625694 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:11.625659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:16.957676 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:16.957643 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:17.011561 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:17.011524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:19.759018 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:19.758982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:19.814844 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:19.814803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:19.878777 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:19.878746 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:19.964559 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:19.964531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:20.036998 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:20.036921 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:22.769647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:22.769607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.006469 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.006431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.228516 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.228482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.283019 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.282940 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rsgd8"] Jun 07 16:06:24.290621 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.290602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.293005 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.292980 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 16:06:24.293172 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.293026 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 16:06:24.293799 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.293778 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 16:06:24.293994 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.293958 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 16:06:24.294978 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.294952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7s4zr\"" Jun 07 16:06:24.295088 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.295040 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 16:06:24.295140 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.295124 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 16:06:24.311463 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nzr5\" (UniqueName: \"kubernetes.io/projected/ec8c898d-cc8c-444d-83d6-9920e46e13f5-kube-api-access-4nzr5\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311598 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311598 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311531 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-root\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311598 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-textfile\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311715 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311715 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8c898d-cc8c-444d-83d6-9920e46e13f5-metrics-client-ca\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311715 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311688 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-wtmp\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311715 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-sys\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.311887 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.311724 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-tls\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.320676 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.320655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.388619 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.388585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.412732 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-sys\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.412873 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-tls\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.412873 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nzr5\" (UniqueName: \"kubernetes.io/projected/ec8c898d-cc8c-444d-83d6-9920e46e13f5-kube-api-access-4nzr5\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.412873 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.412873 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412849 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-sys\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.412873 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-root\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:24.412897 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412897 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-root\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.412955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-textfile\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:24.412985 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-tls podName:ec8c898d-cc8c-444d-83d6-9920e46e13f5 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:24.912963225 +0000 UTC m=+277.498801618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-tls") pod "node-exporter-rsgd8" (UID: "ec8c898d-cc8c-444d-83d6-9920e46e13f5") : secret "node-exporter-tls" not found Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8c898d-cc8c-444d-83d6-9920e46e13f5-metrics-client-ca\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413119 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-wtmp\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413461 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413233 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-wtmp\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413461 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-textfile\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413682 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.413718 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.413661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8c898d-cc8c-444d-83d6-9920e46e13f5-metrics-client-ca\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.415103 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.415085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.421749 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.421724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nzr5\" (UniqueName: \"kubernetes.io/projected/ec8c898d-cc8c-444d-83d6-9920e46e13f5-kube-api-access-4nzr5\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.494620 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.494582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.594233 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.594153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.654025 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.653993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.708727 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.708697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.887849 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.887743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:24.916635 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.916608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-tls\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.919031 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.919007 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8c898d-cc8c-444d-83d6-9920e46e13f5-node-exporter-tls\") pod \"node-exporter-rsgd8\" (UID: \"ec8c898d-cc8c-444d-83d6-9920e46e13f5\") " pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:24.934045 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:24.934015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:25.199787 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:25.199759 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rsgd8" Jun 07 16:06:25.211860 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:06:25.211813 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8c898d_cc8c_444d_83d6_9920e46e13f5.slice/crio-e732942f1e72241638288aa9e012b56bb2c41d9c1c523bd15adf5a77548451b0 WatchSource:0}: Error finding container e732942f1e72241638288aa9e012b56bb2c41d9c1c523bd15adf5a77548451b0: Status 404 returned error can't find the container with id e732942f1e72241638288aa9e012b56bb2c41d9c1c523bd15adf5a77548451b0 Jun 07 16:06:25.231973 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:25.231933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:25.315542 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:25.315491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:25.932087 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:25.932053 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:25.969998 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:25.969962 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsgd8" event={"ID":"ec8c898d-cc8c-444d-83d6-9920e46e13f5","Type":"ContainerStarted","Data":"e732942f1e72241638288aa9e012b56bb2c41d9c1c523bd15adf5a77548451b0"} Jun 07 16:06:26.032940 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:26.032916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:26.977059 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:26.977022 2572 generic.go:356] "Generic (PLEG): container finished" podID="ec8c898d-cc8c-444d-83d6-9920e46e13f5" containerID="9778e38ebd2b77eef33c485a5a4567f09a70eba48fbfd509f4220497916e50e0" exitCode=0 Jun 07 16:06:26.977059 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:26.977065 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsgd8" event={"ID":"ec8c898d-cc8c-444d-83d6-9920e46e13f5","Type":"ContainerDied","Data":"9778e38ebd2b77eef33c485a5a4567f09a70eba48fbfd509f4220497916e50e0"} Jun 07 16:06:27.167558 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:27.167513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:27.233633 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:27.233547 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:27.457502 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:27.457468 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:27.684114 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:27.684033 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:27.981925 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:27.981890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsgd8" event={"ID":"ec8c898d-cc8c-444d-83d6-9920e46e13f5","Type":"ContainerStarted","Data":"d4e6a80fae26a94b9783a248bbef8c5896202281a30013109fb3b17004065288"} Jun 07 16:06:27.982312 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:27.981943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rsgd8" event={"ID":"ec8c898d-cc8c-444d-83d6-9920e46e13f5","Type":"ContainerStarted","Data":"327690781dbf1dcb497c612957a309d56f59040f1abf4458b7803f83614b04d3"} Jun 07 16:06:28.004004 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:28.003953 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rsgd8" podStartSLOduration=3.124313606 podStartE2EDuration="4.003938604s" totalImagesPullingTime="812.351456ms" totalInitContainerRuntime="67.273542ms" isStatefulPod=true podCreationTimestamp="2026-06-07 16:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:28.002291815 +0000 UTC m=+280.588130267" watchObservedRunningTime="2026-06-07 16:06:28.003938604 +0000 UTC m=+280.589777019" Jun 07 16:06:29.036489 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:29.036456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:29.152546 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:29.152513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:29.604471 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:29.604431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" Jun 07 16:06:29.604471 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:29.604431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4q4wd" podUID="75c27db2-6786-471c-8492-171dc3c290a9" Jun 07 16:06:29.657104 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:29.657058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:29.988593 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:29.988560 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:06:29.988774 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:29.988560 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4q4wd" Jun 07 16:06:30.434527 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:30.434439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:33.280923 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.280876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:06:33.283348 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.283321 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"image-registry-7bbd66d8bd-lv8n8\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:06:33.291520 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.291491 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2s77n\"" Jun 07 16:06:33.299275 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.299251 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:06:33.429972 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.429937 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bbd66d8bd-lv8n8"] Jun 07 16:06:33.434083 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:06:33.434053 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41efb4e0_2662_44e7_a64b_f8495c68fa5b.slice/crio-a14a220779196f93a798bc342db1ded67f97001ef322d5ce9d446131e417492b WatchSource:0}: Error finding container a14a220779196f93a798bc342db1ded67f97001ef322d5ce9d446131e417492b: Status 404 returned error can't find the container with id a14a220779196f93a798bc342db1ded67f97001ef322d5ce9d446131e417492b Jun 07 16:06:33.583077 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.582980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:06:33.585443 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.585416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75c27db2-6786-471c-8492-171dc3c290a9-metrics-tls\") pod \"dns-default-4q4wd\" (UID: \"75c27db2-6786-471c-8492-171dc3c290a9\") " pod="openshift-dns/dns-default-4q4wd" Jun 07 16:06:33.591594 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.591576 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g7mpp\"" Jun 07 16:06:33.600340 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.600313 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4q4wd" Jun 07 16:06:33.738002 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:33.737968 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4q4wd"] Jun 07 16:06:33.766175 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:06:33.766138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c27db2_6786_471c_8492_171dc3c290a9.slice/crio-ea87329cbfe6769c2b6bd77cba30da1da4a5fcca5392072d5494a8ae397c8f1c WatchSource:0}: Error finding container ea87329cbfe6769c2b6bd77cba30da1da4a5fcca5392072d5494a8ae397c8f1c: Status 404 returned error can't find the container with id ea87329cbfe6769c2b6bd77cba30da1da4a5fcca5392072d5494a8ae397c8f1c Jun 07 16:06:34.003115 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.003078 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4q4wd" event={"ID":"75c27db2-6786-471c-8492-171dc3c290a9","Type":"ContainerStarted","Data":"ea87329cbfe6769c2b6bd77cba30da1da4a5fcca5392072d5494a8ae397c8f1c"} Jun 07 16:06:34.004972 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.004895 2572 generic.go:356] "Generic (PLEG): container finished" podID="0906f640-00b5-4418-890d-71c64a74084e" containerID="83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7" exitCode=1 Jun 07 16:06:34.005136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.004974 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" event={"ID":"0906f640-00b5-4418-890d-71c64a74084e","Type":"ContainerDied","Data":"83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7"} Jun 07 16:06:34.005136 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.005045 2572 scope.go:117] "RemoveContainer" containerID="506dcac451ef546ee9c15df249473e738d21591277129187b584c5aab8fb3bd7" Jun 07 16:06:34.005428 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.005407 2572 scope.go:117] "RemoveContainer" containerID="83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7" Jun 07 16:06:34.005651 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:34.005618 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7f4b4d4b66-vxp9s_open-cluster-management-agent-addon(0906f640-00b5-4418-890d-71c64a74084e)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" podUID="0906f640-00b5-4418-890d-71c64a74084e" Jun 07 16:06:34.006660 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.006638 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" event={"ID":"41efb4e0-2662-44e7-a64b-f8495c68fa5b","Type":"ContainerStarted","Data":"1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c"} Jun 07 16:06:34.006751 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.006679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" event={"ID":"41efb4e0-2662-44e7-a64b-f8495c68fa5b","Type":"ContainerStarted","Data":"a14a220779196f93a798bc342db1ded67f97001ef322d5ce9d446131e417492b"} Jun 07 16:06:34.006751 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.006736 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:06:34.008260 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.008240 2572 generic.go:356] "Generic (PLEG): container finished" podID="c15c80b1-f0de-49b1-a9c4-99ecda79c757" containerID="32677b65749b9d5d8a163aeed5226704e6c236b6c5f693a0b34ef33b42a28a7a" exitCode=255 Jun 07 16:06:34.008351 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.008268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" event={"ID":"c15c80b1-f0de-49b1-a9c4-99ecda79c757","Type":"ContainerDied","Data":"32677b65749b9d5d8a163aeed5226704e6c236b6c5f693a0b34ef33b42a28a7a"} Jun 07 16:06:34.008510 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.008498 2572 scope.go:117] "RemoveContainer" containerID="32677b65749b9d5d8a163aeed5226704e6c236b6c5f693a0b34ef33b42a28a7a" Jun 07 16:06:34.008637 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:34.008622 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5f74676bd4-47zn6_open-cluster-management-agent-addon(c15c80b1-f0de-49b1-a9c4-99ecda79c757)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" podUID="c15c80b1-f0de-49b1-a9c4-99ecda79c757" Jun 07 16:06:34.016801 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.016774 2572 scope.go:117] "RemoveContainer" containerID="accb28db61aa156c7e2ea5d9865f3d7cfe81ba3eb0eba7e4f4d33a65861f6a47" Jun 07 16:06:34.051875 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.051806 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" podStartSLOduration=286.051790853 podStartE2EDuration="4m46.051790853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:34.050646602 +0000 UTC m=+286.636485017" watchObservedRunningTime="2026-06-07 16:06:34.051790853 +0000 UTC m=+286.637629267" Jun 07 16:06:34.634860 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:34.634759 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:06:35.015843 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:35.015801 2572 scope.go:117] "RemoveContainer" containerID="83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7" Jun 07 16:06:35.016037 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:35.016013 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7f4b4d4b66-vxp9s_open-cluster-management-agent-addon(0906f640-00b5-4418-890d-71c64a74084e)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" podUID="0906f640-00b5-4418-890d-71c64a74084e" Jun 07 16:06:35.518120 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:35.518085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:35.619166 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:35.619129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:36.026214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:36.026130 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4q4wd" event={"ID":"75c27db2-6786-471c-8492-171dc3c290a9","Type":"ContainerStarted","Data":"19bd0dc3f6259a6339eb8c3875d598cc48ef2201ebb7208431b4800c7511a256"} Jun 07 16:06:36.026214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:36.026207 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4q4wd" event={"ID":"75c27db2-6786-471c-8492-171dc3c290a9","Type":"ContainerStarted","Data":"3d452812f9ff88dace3984cdd032630e18b43211da2929de691efd63ec114830"} Jun 07 16:06:36.026613 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:36.026348 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4q4wd" Jun 07 16:06:36.042741 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:36.042694 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4q4wd" podStartSLOduration=251.106841042 podStartE2EDuration="4m13.042679909s" totalImagesPullingTime="1.935838867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:36.041071991 +0000 UTC m=+288.626910405" watchObservedRunningTime="2026-06-07 16:06:36.042679909 +0000 UTC m=+288.628518323" Jun 07 16:06:36.979132 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:36.979101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:37.081424 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:37.081389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:37.181915 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:37.181885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:43.601738 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:43.601701 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" Jun 07 16:06:43.602172 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:43.602053 2572 scope.go:117] "RemoveContainer" containerID="32677b65749b9d5d8a163aeed5226704e6c236b6c5f693a0b34ef33b42a28a7a" Jun 07 16:06:43.602229 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:43.602209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5f74676bd4-47zn6_open-cluster-management-agent-addon(c15c80b1-f0de-49b1-a9c4-99ecda79c757)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" podUID="c15c80b1-f0de-49b1-a9c4-99ecda79c757" Jun 07 16:06:43.610170 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:43.610136 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" podUID="37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 16:06:43.628597 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:43.628551 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:06:43.629020 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:43.629007 2572 scope.go:117] "RemoveContainer" containerID="83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7" Jun 07 16:06:43.629185 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:06:43.629166 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7f4b4d4b66-vxp9s_open-cluster-management-agent-addon(0906f640-00b5-4418-890d-71c64a74084e)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" podUID="0906f640-00b5-4418-890d-71c64a74084e" Jun 07 16:06:44.979659 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:44.979626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:45.028651 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:45.028622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:46.019483 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:46.019449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:46.032109 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:46.032085 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4q4wd" Jun 07 16:06:47.813287 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:47.813262 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:06:47.819728 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:47.819697 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:06:47.820197 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:47.820176 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 16:06:53.303937 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:53.303895 2572 patch_prober.go:28] interesting pod/image-registry-7bbd66d8bd-lv8n8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:53.306227 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:53.303953 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:53.610102 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:53.610004 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" podUID="37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 16:06:54.501169 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:54.501139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:54.654840 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:54.654805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:54.879512 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:54.879424 2572 scope.go:117] "RemoveContainer" containerID="32677b65749b9d5d8a163aeed5226704e6c236b6c5f693a0b34ef33b42a28a7a" Jun 07 16:06:55.021770 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.021739 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:06:55.089733 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.089696 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f74676bd4-47zn6" event={"ID":"c15c80b1-f0de-49b1-a9c4-99ecda79c757","Type":"ContainerStarted","Data":"90c3e939e9e38240f2d0debf41b3f64ff8424f9f2457726701ac9d320344391b"} Jun 07 16:06:55.139317 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.139227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:55.184229 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.184199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:55.315338 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.315304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:55.416078 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.416001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:55.567271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.567238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:55.624166 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:55.624129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:06:57.880515 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:57.880482 2572 scope.go:117] "RemoveContainer" containerID="83b61fd7d8b1921f9eca1692d6ecfef54a4c3f5970c66dfd8d50e3f8ffde24f7" Jun 07 16:06:58.102516 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:58.102481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" event={"ID":"0906f640-00b5-4418-890d-71c64a74084e","Type":"ContainerStarted","Data":"60f0220fb059a2ba95b736c98503d4cab6e2014c03b2cc71184885e5c5c67f77"} Jun 07 16:06:58.102851 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:58.102793 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:06:58.104305 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:06:58.104281 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f4b4d4b66-vxp9s" Jun 07 16:07:01.010576 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:01.010539 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bbd66d8bd-lv8n8"] Jun 07 16:07:01.087947 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:01.087914 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:01.188126 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:01.188092 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:03.610423 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:03.610385 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" podUID="37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 16:07:03.610781 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:03.610452 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" Jun 07 16:07:03.610974 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:03.610932 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"971a039fe5771e39229bc0cba5c1d173b71c3eed1999a81064c4e98e0e17d01d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 07 16:07:03.611021 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:03.610995 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" podUID="37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0" containerName="service-proxy" containerID="cri-o://971a039fe5771e39229bc0cba5c1d173b71c3eed1999a81064c4e98e0e17d01d" gracePeriod=30 Jun 07 16:07:04.124750 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.124718 2572 generic.go:356] "Generic (PLEG): container finished" podID="37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0" containerID="971a039fe5771e39229bc0cba5c1d173b71c3eed1999a81064c4e98e0e17d01d" exitCode=2 Jun 07 16:07:04.124965 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.124796 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" event={"ID":"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0","Type":"ContainerDied","Data":"971a039fe5771e39229bc0cba5c1d173b71c3eed1999a81064c4e98e0e17d01d"} Jun 07 16:07:04.124965 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.124865 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c6bc7585f-trkjl" event={"ID":"37d7edd0-c9ff-4fac-b783-67bb6ce9ebf0","Type":"ContainerStarted","Data":"438aeddc92008a58df0a19b02617ee3a3c0c4528c355c0e9b854fb085654596b"} Jun 07 16:07:04.153165 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.153126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:04.205218 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.205191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:04.635373 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.635341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:04.736515 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:04.736482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:08.319164 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:08.319124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:08.373535 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:08.373508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:10.330263 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:10.330226 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:10.430446 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:10.430399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:16.915367 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:16.915309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:17.016347 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:17.016301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:17.116563 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:17.116508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:23.090301 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:23.090267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:23.139386 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:23.139355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:25.319966 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:25.319933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:25.378902 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:25.378870 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:26.030041 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:26.030004 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" containerName="registry" containerID="cri-o://1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c" gracePeriod=30 Jun 07 16:07:27.371370 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.371347 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:07:27.466314 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466283 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-installation-pull-secrets\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466330 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41efb4e0-2662-44e7-a64b-f8495c68fa5b-ca-trust-extracted\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466354 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-bound-sa-token\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466386 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw675\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-kube-api-access-vw675\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466434 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-certificates\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466467 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-image-registry-private-configuration\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.466809 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466508 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-trusted-ca\") pod \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\" (UID: \"41efb4e0-2662-44e7-a64b-f8495c68fa5b\") " Jun 07 16:07:27.467028 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466960 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:07:27.467028 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.466988 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:07:27.469344 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.469249 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:07:27.469497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.469442 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:07:27.469497 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.469464 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:07:27.469609 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.469516 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:07:27.469609 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.469523 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-kube-api-access-vw675" (OuterVolumeSpecName: "kube-api-access-vw675") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "kube-api-access-vw675". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:07:27.475118 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.475092 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41efb4e0-2662-44e7-a64b-f8495c68fa5b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "41efb4e0-2662-44e7-a64b-f8495c68fa5b" (UID: "41efb4e0-2662-44e7-a64b-f8495c68fa5b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:07:27.567587 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567548 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw675\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-kube-api-access-vw675\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567587 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567580 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-certificates\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567587 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567592 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-image-registry-private-configuration\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567870 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567604 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41efb4e0-2662-44e7-a64b-f8495c68fa5b-trusted-ca\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567870 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567613 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41efb4e0-2662-44e7-a64b-f8495c68fa5b-installation-pull-secrets\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567870 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567621 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41efb4e0-2662-44e7-a64b-f8495c68fa5b-ca-trust-extracted\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567870 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567629 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-bound-sa-token\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:27.567870 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:27.567636 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41efb4e0-2662-44e7-a64b-f8495c68fa5b-registry-tls\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:07:28.202254 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.202220 2572 generic.go:356] "Generic (PLEG): container finished" podID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" containerID="1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c" exitCode=0 Jun 07 16:07:28.202447 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.202287 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" Jun 07 16:07:28.202447 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.202312 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" event={"ID":"41efb4e0-2662-44e7-a64b-f8495c68fa5b","Type":"ContainerDied","Data":"1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c"} Jun 07 16:07:28.202447 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.202395 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bbd66d8bd-lv8n8" event={"ID":"41efb4e0-2662-44e7-a64b-f8495c68fa5b","Type":"ContainerDied","Data":"a14a220779196f93a798bc342db1ded67f97001ef322d5ce9d446131e417492b"} Jun 07 16:07:28.202447 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.202424 2572 scope.go:117] "RemoveContainer" containerID="1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c" Jun 07 16:07:28.210350 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.210333 2572 scope.go:117] "RemoveContainer" containerID="1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c" Jun 07 16:07:28.210632 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:07:28.210611 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c\": container with ID starting with 1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c not found: ID does not exist" containerID="1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c" Jun 07 16:07:28.210682 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.210642 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c"} err="failed to get container status \"1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c\": rpc error: code = NotFound desc = could not find container \"1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c\": container with ID starting with 1cd1d36acbc7c69e4848f74919e165713320d5a208d982c50271581eaeaf2f7c not found: ID does not exist" Jun 07 16:07:28.218197 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.218175 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bbd66d8bd-lv8n8"] Jun 07 16:07:28.223450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:28.223429 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bbd66d8bd-lv8n8"] Jun 07 16:07:29.306611 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:29.306570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:29.368288 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:29.368258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:29.884023 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:29.883994 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" path="/var/lib/kubelet/pods/41efb4e0-2662-44e7-a64b-f8495c68fa5b/volumes" Jun 07 16:07:30.159791 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:30.159711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:30.213251 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:30.213221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:40.301346 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:40.301237 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:40.354535 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:40.354500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:41.489316 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:41.489288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:41.540061 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:41.540026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:55.323888 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:55.323853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:55.422160 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:55.422124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:58.936794 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:58.936757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:07:58.984441 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:07:58.984407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:08:09.442423 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:08:09.442390 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:08:09.542806 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:08:09.542778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:08:09.590157 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:08:09.590132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:08:58.021675 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:08:58.021635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:08:58.119679 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:08:58.119635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:09.110945 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:09.110852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:09.166245 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:09.166210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:24.561784 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:24.561705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:25.368746 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:25.368695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:28.171363 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:28.171319 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:28.272740 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:28.272667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:30.408193 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:30.408150 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:30.509334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:30.509261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:30.992228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:30.992178 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:31.111195 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:31.111151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:33.712803 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:33.712766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:34.305732 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:34.305690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:34.958674 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:34.958631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:35.010043 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:35.010013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:38.947721 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:38.947694 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:39.010883 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:39.010845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:42.115702 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:42.115667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:44.773974 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:44.773938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:44.877022 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:44.876990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:46.802630 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.802593 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg"] Jun 07 16:09:46.803125 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.802974 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" containerName="registry" Jun 07 16:09:46.803125 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.802993 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" containerName="registry" Jun 07 16:09:46.803125 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.803073 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="41efb4e0-2662-44e7-a64b-f8495c68fa5b" containerName="registry" Jun 07 16:09:46.805799 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.805779 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:46.808118 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.808098 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:09:46.808214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.808126 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 16:09:46.808953 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.808931 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pc24v\"" Jun 07 16:09:46.813875 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.813852 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg"] Jun 07 16:09:46.830992 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.830967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtv7z\" (UniqueName: \"kubernetes.io/projected/fae226b1-41b1-4bbc-b812-f0bd1a23dc54-kube-api-access-mtv7z\") pod \"openshift-lws-operator-fd8ccff4c-fw2pg\" (UID: \"fae226b1-41b1-4bbc-b812-f0bd1a23dc54\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:46.831113 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.831008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fae226b1-41b1-4bbc-b812-f0bd1a23dc54-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fw2pg\" (UID: \"fae226b1-41b1-4bbc-b812-f0bd1a23dc54\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:46.931564 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.931531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtv7z\" (UniqueName: \"kubernetes.io/projected/fae226b1-41b1-4bbc-b812-f0bd1a23dc54-kube-api-access-mtv7z\") pod \"openshift-lws-operator-fd8ccff4c-fw2pg\" (UID: \"fae226b1-41b1-4bbc-b812-f0bd1a23dc54\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:46.931709 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.931571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fae226b1-41b1-4bbc-b812-f0bd1a23dc54-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fw2pg\" (UID: \"fae226b1-41b1-4bbc-b812-f0bd1a23dc54\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:46.931922 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.931905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fae226b1-41b1-4bbc-b812-f0bd1a23dc54-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fw2pg\" (UID: \"fae226b1-41b1-4bbc-b812-f0bd1a23dc54\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:46.939369 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:46.939337 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtv7z\" (UniqueName: \"kubernetes.io/projected/fae226b1-41b1-4bbc-b812-f0bd1a23dc54-kube-api-access-mtv7z\") pod \"openshift-lws-operator-fd8ccff4c-fw2pg\" (UID: \"fae226b1-41b1-4bbc-b812-f0bd1a23dc54\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:47.115214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:47.115119 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" Jun 07 16:09:47.247441 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:47.247405 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg"] Jun 07 16:09:47.250473 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:09:47.250447 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfae226b1_41b1_4bbc_b812_f0bd1a23dc54.slice/crio-f12b9ea99109cc21c4e8039689382ded4eb18297884a275db83e6e00dff314dd WatchSource:0}: Error finding container f12b9ea99109cc21c4e8039689382ded4eb18297884a275db83e6e00dff314dd: Status 404 returned error can't find the container with id f12b9ea99109cc21c4e8039689382ded4eb18297884a275db83e6e00dff314dd Jun 07 16:09:47.251869 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:47.251853 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:09:47.645261 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:47.645223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" event={"ID":"fae226b1-41b1-4bbc-b812-f0bd1a23dc54","Type":"ContainerStarted","Data":"f12b9ea99109cc21c4e8039689382ded4eb18297884a275db83e6e00dff314dd"} Jun 07 16:09:51.663037 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:51.663004 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" event={"ID":"fae226b1-41b1-4bbc-b812-f0bd1a23dc54","Type":"ContainerStarted","Data":"d44e5d12917b54a2b6044673ff4b135a0beacb7cbe3132f2611cffc84686c3e3"} Jun 07 16:09:51.677591 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:51.677534 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fw2pg" podStartSLOduration=2.106918437 podStartE2EDuration="5.677515971s" totalImagesPullingTime="3.570597534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:09:51.676315016 +0000 UTC m=+484.262153429" watchObservedRunningTime="2026-06-07 16:09:51.677515971 +0000 UTC m=+484.263354389" Jun 07 16:09:52.311519 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:52.311484 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:52.416008 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:52.415971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:09:54.463636 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:09:54.463598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:06.790631 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:06.790593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:06.888012 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:06.887981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:07.382594 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.382556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:07.611110 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.611065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:07.705489 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.705455 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:07.715529 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.715501 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq"] Jun 07 16:10:07.718808 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.718789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.721770 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.721750 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 16:10:07.722120 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.722082 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 16:10:07.722120 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.722092 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 16:10:07.722265 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.722127 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 16:10:07.722265 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.722184 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srqqz\"" Jun 07 16:10:07.738151 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.738126 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq"] Jun 07 16:10:07.785774 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.785737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.785999 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.785811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.785999 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.785877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qfgq\" (UniqueName: \"kubernetes.io/projected/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-kube-api-access-8qfgq\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.785999 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.785912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.785999 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.785941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.886365 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.886326 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.886882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.886383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qfgq\" (UniqueName: \"kubernetes.io/projected/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-kube-api-access-8qfgq\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.886882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.886418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.886882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.886452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.886882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.886515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.887080 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.887018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.889019 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.888991 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.889262 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.889239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.889462 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.889445 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.897352 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.897328 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qfgq\" (UniqueName: \"kubernetes.io/projected/0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f-kube-api-access-8qfgq\") pod \"opendatahub-operator-controller-manager-79675d457c-skgzq\" (UID: \"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:07.924182 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:07.924152 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.024717 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.024634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.028629 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.028603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:08.124879 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.124845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.165413 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.165319 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq"] Jun 07 16:10:08.168105 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:10:08.168082 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa8daf0_1729_4b0e_9d0c_20e2c84e9f7f.slice/crio-a53a3a905dcf73f4dccb55af0ae67c85e53667eaf98bf3e434cad17f1cea0b4a WatchSource:0}: Error finding container a53a3a905dcf73f4dccb55af0ae67c85e53667eaf98bf3e434cad17f1cea0b4a: Status 404 returned error can't find the container with id a53a3a905dcf73f4dccb55af0ae67c85e53667eaf98bf3e434cad17f1cea0b4a Jun 07 16:10:08.194538 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.194510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.248893 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.248862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.351638 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.351552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.455994 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.455961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:08.723894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:08.723860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" event={"ID":"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f","Type":"ContainerStarted","Data":"a53a3a905dcf73f4dccb55af0ae67c85e53667eaf98bf3e434cad17f1cea0b4a"} Jun 07 16:10:09.853612 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:09.853577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:09.954346 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:09.954302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:11.736330 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:11.736290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" event={"ID":"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f","Type":"ContainerStarted","Data":"5a973d3c567f4b0a6b209d61a9932ef6b996de5ba141808bd3fe8a847f579d68"} Jun 07 16:10:11.998911 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:11.998797 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:12.047087 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:12.047055 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:12.741459 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:12.741424 2572 generic.go:356] "Generic (PLEG): container finished" podID="0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f" containerID="5a973d3c567f4b0a6b209d61a9932ef6b996de5ba141808bd3fe8a847f579d68" exitCode=0 Jun 07 16:10:12.741883 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:12.741493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" event={"ID":"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f","Type":"ContainerDied","Data":"5a973d3c567f4b0a6b209d61a9932ef6b996de5ba141808bd3fe8a847f579d68"} Jun 07 16:10:13.747888 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:13.747851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" event={"ID":"0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f","Type":"ContainerStarted","Data":"94d4bdd0380c13af4e9359e1f314360be2a25eefb4af2bf024074e406e7043fc"} Jun 07 16:10:13.748340 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:13.747994 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:13.769208 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:13.769145 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" podStartSLOduration=2.384399431 podStartE2EDuration="6.76912458s" totalImagesPullingTime="3.33280803s" totalInitContainerRuntime="1.051917119s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:13.76747219 +0000 UTC m=+506.353310604" watchObservedRunningTime="2026-06-07 16:10:13.76912458 +0000 UTC m=+506.354962996" Jun 07 16:10:17.134127 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:17.134098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:18.249579 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:18.249543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:18.346624 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:18.346590 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:24.753594 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:24.753561 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-skgzq" Jun 07 16:10:26.474144 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.474116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:26.579834 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.579803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:26.679098 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.679047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:26.709551 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.709517 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-746d4cf656-rtgln"] Jun 07 16:10:26.719980 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.719949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.722668 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.722640 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 16:10:26.722842 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.722641 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 16:10:26.724063 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.724041 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 16:10:26.724218 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.724043 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lrndp\"" Jun 07 16:10:26.724218 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.724071 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 16:10:26.726025 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.725975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-746d4cf656-rtgln"] Jun 07 16:10:26.775408 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.775378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:26.828895 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.828817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ac4379-4e05-4989-817c-afd34ef09e12-tmp\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.828895 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.828897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqqb9\" (UniqueName: \"kubernetes.io/projected/68ac4379-4e05-4989-817c-afd34ef09e12-kube-api-access-vqqb9\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.829108 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.828988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68ac4379-4e05-4989-817c-afd34ef09e12-tls-certs\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.930074 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.930022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ac4379-4e05-4989-817c-afd34ef09e12-tmp\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.930256 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.930084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqqb9\" (UniqueName: \"kubernetes.io/projected/68ac4379-4e05-4989-817c-afd34ef09e12-kube-api-access-vqqb9\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.930256 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.930136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68ac4379-4e05-4989-817c-afd34ef09e12-tls-certs\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.932334 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.932303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ac4379-4e05-4989-817c-afd34ef09e12-tmp\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.932683 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.932659 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68ac4379-4e05-4989-817c-afd34ef09e12-tls-certs\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:26.945736 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:26.945704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqqb9\" (UniqueName: \"kubernetes.io/projected/68ac4379-4e05-4989-817c-afd34ef09e12-kube-api-access-vqqb9\") pod \"kube-auth-proxy-746d4cf656-rtgln\" (UID: \"68ac4379-4e05-4989-817c-afd34ef09e12\") " pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:27.007759 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.007659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:27.031769 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.031738 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" Jun 07 16:10:27.170449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.170417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-746d4cf656-rtgln"] Jun 07 16:10:27.173700 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:10:27.173668 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ac4379_4e05_4989_817c_afd34ef09e12.slice/crio-242ca0f5b4fe8b9e882a9276c09c08ba26d7cf55d248ffa33531466b403ab745 WatchSource:0}: Error finding container 242ca0f5b4fe8b9e882a9276c09c08ba26d7cf55d248ffa33531466b403ab745: Status 404 returned error can't find the container with id 242ca0f5b4fe8b9e882a9276c09c08ba26d7cf55d248ffa33531466b403ab745 Jun 07 16:10:27.400034 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.399923 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:27.499952 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.499908 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:27.599991 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.599958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:27.701530 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.701503 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:27.800054 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.800014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" event={"ID":"68ac4379-4e05-4989-817c-afd34ef09e12","Type":"ContainerStarted","Data":"242ca0f5b4fe8b9e882a9276c09c08ba26d7cf55d248ffa33531466b403ab745"} Jun 07 16:10:27.801664 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:27.801611 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:28.024148 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:28.024075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:28.115884 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:28.115851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:30.814424 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:30.814388 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" event={"ID":"68ac4379-4e05-4989-817c-afd34ef09e12","Type":"ContainerStarted","Data":"0600ac0458b7532e72be706957872ed42dd6d7db2cef213b413c2e7ff7491a06"} Jun 07 16:10:30.833185 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:30.833123 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-746d4cf656-rtgln" podStartSLOduration=2.012184382 podStartE2EDuration="4.833106222s" totalImagesPullingTime="2.82092184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:30.832303057 +0000 UTC m=+523.418141472" watchObservedRunningTime="2026-06-07 16:10:30.833106222 +0000 UTC m=+523.418944637" Jun 07 16:10:33.789270 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.789229 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4"] Jun 07 16:10:33.791642 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.791618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.795038 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.795012 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 07 16:10:33.795038 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.795032 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 07 16:10:33.795214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.795054 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ng599\"" Jun 07 16:10:33.795214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.795032 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 07 16:10:33.802181 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.802157 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4"] Jun 07 16:10:33.886732 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.886702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/995e1912-fc59-41ac-84d1-df1a09f016c5-manager-config\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.886942 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.886773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/995e1912-fc59-41ac-84d1-df1a09f016c5-metrics-cert\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.886942 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.886866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqgq\" (UniqueName: \"kubernetes.io/projected/995e1912-fc59-41ac-84d1-df1a09f016c5-kube-api-access-jdqgq\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.886942 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.886901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995e1912-fc59-41ac-84d1-df1a09f016c5-cert\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.988107 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.988071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/995e1912-fc59-41ac-84d1-df1a09f016c5-manager-config\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.988305 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.988133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/995e1912-fc59-41ac-84d1-df1a09f016c5-metrics-cert\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.988305 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.988163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqgq\" (UniqueName: \"kubernetes.io/projected/995e1912-fc59-41ac-84d1-df1a09f016c5-kube-api-access-jdqgq\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.988305 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.988193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995e1912-fc59-41ac-84d1-df1a09f016c5-cert\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.988722 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.988700 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/995e1912-fc59-41ac-84d1-df1a09f016c5-manager-config\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.990725 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.990708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995e1912-fc59-41ac-84d1-df1a09f016c5-cert\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.990780 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.990767 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/995e1912-fc59-41ac-84d1-df1a09f016c5-metrics-cert\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:33.995708 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:33.995676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqgq\" (UniqueName: \"kubernetes.io/projected/995e1912-fc59-41ac-84d1-df1a09f016c5-kube-api-access-jdqgq\") pod \"lws-controller-manager-594b75d8b-gjtd4\" (UID: \"995e1912-fc59-41ac-84d1-df1a09f016c5\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:34.101103 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:34.101006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:34.230359 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:34.230326 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4"] Jun 07 16:10:34.233637 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:10:34.233607 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995e1912_fc59_41ac_84d1_df1a09f016c5.slice/crio-1fe6140ff690e1f8dbed499d8be7ace3e3c29d7a6e6866fdae3e5ebece151841 WatchSource:0}: Error finding container 1fe6140ff690e1f8dbed499d8be7ace3e3c29d7a6e6866fdae3e5ebece151841: Status 404 returned error can't find the container with id 1fe6140ff690e1f8dbed499d8be7ace3e3c29d7a6e6866fdae3e5ebece151841 Jun 07 16:10:34.831671 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:34.831635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" event={"ID":"995e1912-fc59-41ac-84d1-df1a09f016c5","Type":"ContainerStarted","Data":"1fe6140ff690e1f8dbed499d8be7ace3e3c29d7a6e6866fdae3e5ebece151841"} Jun 07 16:10:35.836556 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:35.836516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" event={"ID":"995e1912-fc59-41ac-84d1-df1a09f016c5","Type":"ContainerStarted","Data":"97e69b43f4142f7961c3a6ccf00cd9ffba1313291a7c577fccc6a6e2dfbd7473"} Jun 07 16:10:35.837044 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:35.836648 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:35.854058 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:35.853985 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" podStartSLOduration=1.392302411 podStartE2EDuration="2.853966929s" totalImagesPullingTime="1.461664518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:35.853345145 +0000 UTC m=+528.439183557" watchObservedRunningTime="2026-06-07 16:10:35.853966929 +0000 UTC m=+528.439805344" Jun 07 16:10:36.755970 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:36.755935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:36.874098 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:36.874033 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:36.994620 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:36.994575 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:37.466463 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:37.466383 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:38.081138 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:38.081097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:38.189168 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:38.189135 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:43.537307 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:43.537270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:43.637167 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:43.637127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:44.648269 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:44.648163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:44.761866 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:44.761808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:45.433028 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:45.432993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:45.616867 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:45.616769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:46.039215 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:46.039183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:46.842859 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:46.842804 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-gjtd4" Jun 07 16:10:56.293379 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:56.293348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:10:57.391280 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:10:57.391202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:08.369590 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:08.369537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:08.469383 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:08.469329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:14.214595 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:14.214539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:14.263749 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:14.263713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:16.339206 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:16.339168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:16.438346 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:16.438312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:16.833779 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:16.833748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:20.533467 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:20.533426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:20.592271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:20.592236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:20.822747 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:20.822670 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:21.015134 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:21.015079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:21.235466 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:21.235433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:21.700471 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:21.700441 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:28.205148 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:28.205114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:28.302688 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:28.302647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:28.402432 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:28.402393 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:29.132618 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:29.132587 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:29.338573 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:29.338544 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:41.514202 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:41.514168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:41.612019 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:41.611991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:47.836941 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:47.836913 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:11:47.845648 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:47.845628 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:11:52.435603 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:52.435568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:52.489144 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:52.489111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:52.539273 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:52.539239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:11:58.052472 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:11:58.052431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:01.652259 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:01.652217 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:01.767953 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:01.767917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:06.241165 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:06.241129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:06.656596 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:06.656499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:08.152233 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:08.152125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:09.681240 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:09.681192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:10.498559 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:10.498521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:12.486685 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:12.486651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:13.844616 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:13.844578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:13.945538 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:13.945485 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:14.617847 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.617787 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz"] Jun 07 16:12:14.620998 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.620976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.622369 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.622341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:14.623259 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.623244 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 07 16:12:14.623332 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.623249 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5h6z\"" Jun 07 16:12:14.623377 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.623249 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 07 16:12:14.624040 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.624023 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:12:14.624149 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.624055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:12:14.630046 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.630025 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz"] Jun 07 16:12:14.644645 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.644619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9f03177-341e-4137-9ee9-47310c762b16-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.644796 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.644724 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9f03177-341e-4137-9ee9-47310c762b16-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.644796 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.644750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttwcp\" (UniqueName: \"kubernetes.io/projected/e9f03177-341e-4137-9ee9-47310c762b16-kube-api-access-ttwcp\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.745935 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.745894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9f03177-341e-4137-9ee9-47310c762b16-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.745935 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.745937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttwcp\" (UniqueName: \"kubernetes.io/projected/e9f03177-341e-4137-9ee9-47310c762b16-kube-api-access-ttwcp\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.746153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.745998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9f03177-341e-4137-9ee9-47310c762b16-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.746153 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:12:14.746045 2572 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 07 16:12:14.746153 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:12:14.746123 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f03177-341e-4137-9ee9-47310c762b16-plugin-serving-cert podName:e9f03177-341e-4137-9ee9-47310c762b16 nodeName:}" failed. No retries permitted until 2026-06-07 16:12:15.246101962 +0000 UTC m=+627.831940378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e9f03177-341e-4137-9ee9-47310c762b16-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9xmpz" (UID: "e9f03177-341e-4137-9ee9-47310c762b16") : secret "plugin-serving-cert" not found Jun 07 16:12:14.746694 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.746675 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9f03177-341e-4137-9ee9-47310c762b16-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:14.753721 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:14.753696 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttwcp\" (UniqueName: \"kubernetes.io/projected/e9f03177-341e-4137-9ee9-47310c762b16-kube-api-access-ttwcp\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:15.083082 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:15.083051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:15.249199 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:15.249157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9f03177-341e-4137-9ee9-47310c762b16-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:15.251594 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:15.251563 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9f03177-341e-4137-9ee9-47310c762b16-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9xmpz\" (UID: \"e9f03177-341e-4137-9ee9-47310c762b16\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:15.531271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:15.531227 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" Jun 07 16:12:15.661054 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:15.661020 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz"] Jun 07 16:12:15.664229 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:12:15.664204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9f03177_341e_4137_9ee9_47310c762b16.slice/crio-ec43c4a02214f311fe9818f3cb31aa838db24c6b5931bf6bf68a44c1e40c7a18 WatchSource:0}: Error finding container ec43c4a02214f311fe9818f3cb31aa838db24c6b5931bf6bf68a44c1e40c7a18: Status 404 returned error can't find the container with id ec43c4a02214f311fe9818f3cb31aa838db24c6b5931bf6bf68a44c1e40c7a18 Jun 07 16:12:16.203197 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:16.203162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" event={"ID":"e9f03177-341e-4137-9ee9-47310c762b16","Type":"ContainerStarted","Data":"ec43c4a02214f311fe9818f3cb31aa838db24c6b5931bf6bf68a44c1e40c7a18"} Jun 07 16:12:17.249785 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:17.249752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:17.309698 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:17.309659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:25.923034 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:25.922991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:26.031243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:26.031188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:26.181728 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:26.181594 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:28.301730 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:28.301685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:28.353129 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:28.353094 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:32.638072 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:32.638036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:32.773145 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:32.773102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:34.868223 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:34.868160 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:34.928997 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:34.928960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:40.305579 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:40.305542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" event={"ID":"e9f03177-341e-4137-9ee9-47310c762b16","Type":"ContainerStarted","Data":"d7c8f0c7b34e57d4a82d35fe9fa617aca455af07dada7aa3bfbd9c7ed87c684d"} Jun 07 16:12:40.340571 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:40.340511 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9xmpz" podStartSLOduration=2.528446024 podStartE2EDuration="26.340494312s" totalImagesPullingTime="23.812048288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:40.340246636 +0000 UTC m=+652.926085052" watchObservedRunningTime="2026-06-07 16:12:40.340494312 +0000 UTC m=+652.926332727" Jun 07 16:12:43.574234 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:43.574197 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:43.688121 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:43.688085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:43.830681 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:43.830598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:46.043685 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:46.043646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:46.099027 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:46.098996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:50.387338 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:50.387301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:50.487146 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:50.487110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:54.187925 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:54.187884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:54.298981 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:54.298947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:56.991282 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:56.991247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:57.094155 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:57.094122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:58.552027 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:58.551995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:58.652450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:58.652418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:12:58.753125 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:12:58.753085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:00.289095 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:00.289056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:04.192521 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:04.192350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:04.293139 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:04.293099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:06.642618 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:06.642584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:06.743759 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:06.743724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:12.413003 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:12.412968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:12.522559 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:12.522531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:12.573691 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:12.573662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:13.215438 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.215396 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4nbg5"] Jun 07 16:13:13.218598 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.218574 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:13.220936 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.220913 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-g25ck\"" Jun 07 16:13:13.223751 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.223721 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nbg5"] Jun 07 16:13:13.246387 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.246354 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:13.303383 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.303343 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:13.326043 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.326013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7hn\" (UniqueName: \"kubernetes.io/projected/d98478cc-12cd-4bfa-842d-779ce2b05ef2-kube-api-access-2n7hn\") pod \"authorino-58cd955675-4nbg5\" (UID: \"d98478cc-12cd-4bfa-842d-779ce2b05ef2\") " pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:13.331764 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.331737 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gj9cj"] Jun 07 16:13:13.334744 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.334728 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:13:13.339186 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.339139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gj9cj"] Jun 07 16:13:13.427363 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.427330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trwcw\" (UniqueName: \"kubernetes.io/projected/3c652512-91d5-472b-a49c-e5fc7fb4f69f-kube-api-access-trwcw\") pod \"authorino-75d556bd77-gj9cj\" (UID: \"3c652512-91d5-472b-a49c-e5fc7fb4f69f\") " pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:13:13.427737 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.427389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7hn\" (UniqueName: \"kubernetes.io/projected/d98478cc-12cd-4bfa-842d-779ce2b05ef2-kube-api-access-2n7hn\") pod \"authorino-58cd955675-4nbg5\" (UID: \"d98478cc-12cd-4bfa-842d-779ce2b05ef2\") " pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:13.435330 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.435303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7hn\" (UniqueName: \"kubernetes.io/projected/d98478cc-12cd-4bfa-842d-779ce2b05ef2-kube-api-access-2n7hn\") pod \"authorino-58cd955675-4nbg5\" (UID: \"d98478cc-12cd-4bfa-842d-779ce2b05ef2\") " pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:13.528454 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.528354 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:13.528595 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.528522 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trwcw\" (UniqueName: \"kubernetes.io/projected/3c652512-91d5-472b-a49c-e5fc7fb4f69f-kube-api-access-trwcw\") pod \"authorino-75d556bd77-gj9cj\" (UID: \"3c652512-91d5-472b-a49c-e5fc7fb4f69f\") " pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:13:13.536085 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.536053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trwcw\" (UniqueName: \"kubernetes.io/projected/3c652512-91d5-472b-a49c-e5fc7fb4f69f-kube-api-access-trwcw\") pod \"authorino-75d556bd77-gj9cj\" (UID: \"3c652512-91d5-472b-a49c-e5fc7fb4f69f\") " pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:13:13.644527 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.644488 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:13:13.656049 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.656021 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nbg5"] Jun 07 16:13:13.658598 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:13:13.658568 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd98478cc_12cd_4bfa_842d_779ce2b05ef2.slice/crio-59e8418e8045a90f64ea9c2fbe98016d36457156f6d3b63beec07c9a0f06bb18 WatchSource:0}: Error finding container 59e8418e8045a90f64ea9c2fbe98016d36457156f6d3b63beec07c9a0f06bb18: Status 404 returned error can't find the container with id 59e8418e8045a90f64ea9c2fbe98016d36457156f6d3b63beec07c9a0f06bb18 Jun 07 16:13:13.774816 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:13.774784 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gj9cj"] Jun 07 16:13:13.778853 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:13:13.778781 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c652512_91d5_472b_a49c_e5fc7fb4f69f.slice/crio-9d4644a72e98cd01b2d1c20025199d4e2e153873dac6e3b96e7593408df132ac WatchSource:0}: Error finding container 9d4644a72e98cd01b2d1c20025199d4e2e153873dac6e3b96e7593408df132ac: Status 404 returned error can't find the container with id 9d4644a72e98cd01b2d1c20025199d4e2e153873dac6e3b96e7593408df132ac Jun 07 16:13:14.436537 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:14.436493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gj9cj" event={"ID":"3c652512-91d5-472b-a49c-e5fc7fb4f69f","Type":"ContainerStarted","Data":"9d4644a72e98cd01b2d1c20025199d4e2e153873dac6e3b96e7593408df132ac"} Jun 07 16:13:14.439088 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:14.439055 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nbg5" event={"ID":"d98478cc-12cd-4bfa-842d-779ce2b05ef2","Type":"ContainerStarted","Data":"59e8418e8045a90f64ea9c2fbe98016d36457156f6d3b63beec07c9a0f06bb18"} Jun 07 16:13:17.460090 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:17.460051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gj9cj" event={"ID":"3c652512-91d5-472b-a49c-e5fc7fb4f69f","Type":"ContainerStarted","Data":"2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3"} Jun 07 16:13:17.461615 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:17.461585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nbg5" event={"ID":"d98478cc-12cd-4bfa-842d-779ce2b05ef2","Type":"ContainerStarted","Data":"6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec"} Jun 07 16:13:17.475539 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:17.475479 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gj9cj" podStartSLOduration=0.964552478 podStartE2EDuration="4.475461638s" totalImagesPullingTime="3.51090916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:13:17.475164892 +0000 UTC m=+690.061003321" watchObservedRunningTime="2026-06-07 16:13:17.475461638 +0000 UTC m=+690.061300053" Jun 07 16:13:17.512406 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:17.512358 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4nbg5" podStartSLOduration=0.891516363 podStartE2EDuration="4.512341231s" totalImagesPullingTime="3.620824868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:13:17.48717685 +0000 UTC m=+690.073015265" watchObservedRunningTime="2026-06-07 16:13:17.512341231 +0000 UTC m=+690.098179645" Jun 07 16:13:17.512652 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:17.512638 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nbg5"] Jun 07 16:13:19.469336 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:19.469299 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4nbg5" podUID="d98478cc-12cd-4bfa-842d-779ce2b05ef2" containerName="authorino" containerID="cri-o://6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec" gracePeriod=30 Jun 07 16:13:19.715738 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:19.715712 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:19.783596 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:19.783500 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n7hn\" (UniqueName: \"kubernetes.io/projected/d98478cc-12cd-4bfa-842d-779ce2b05ef2-kube-api-access-2n7hn\") pod \"d98478cc-12cd-4bfa-842d-779ce2b05ef2\" (UID: \"d98478cc-12cd-4bfa-842d-779ce2b05ef2\") " Jun 07 16:13:19.785697 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:19.785667 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98478cc-12cd-4bfa-842d-779ce2b05ef2-kube-api-access-2n7hn" (OuterVolumeSpecName: "kube-api-access-2n7hn") pod "d98478cc-12cd-4bfa-842d-779ce2b05ef2" (UID: "d98478cc-12cd-4bfa-842d-779ce2b05ef2"). InnerVolumeSpecName "kube-api-access-2n7hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:13:19.884204 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:19.884176 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n7hn\" (UniqueName: \"kubernetes.io/projected/d98478cc-12cd-4bfa-842d-779ce2b05ef2-kube-api-access-2n7hn\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:13:20.475458 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.475422 2572 generic.go:356] "Generic (PLEG): container finished" podID="d98478cc-12cd-4bfa-842d-779ce2b05ef2" containerID="6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec" exitCode=0 Jun 07 16:13:20.475986 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.475468 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nbg5" Jun 07 16:13:20.475986 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.475481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nbg5" event={"ID":"d98478cc-12cd-4bfa-842d-779ce2b05ef2","Type":"ContainerDied","Data":"6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec"} Jun 07 16:13:20.475986 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.475511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nbg5" event={"ID":"d98478cc-12cd-4bfa-842d-779ce2b05ef2","Type":"ContainerDied","Data":"59e8418e8045a90f64ea9c2fbe98016d36457156f6d3b63beec07c9a0f06bb18"} Jun 07 16:13:20.475986 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.475528 2572 scope.go:117] "RemoveContainer" containerID="6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec" Jun 07 16:13:20.483626 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.483604 2572 scope.go:117] "RemoveContainer" containerID="6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec" Jun 07 16:13:20.483964 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:13:20.483944 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec\": container with ID starting with 6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec not found: ID does not exist" containerID="6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec" Jun 07 16:13:20.484015 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.483974 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec"} err="failed to get container status \"6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec\": rpc error: code = NotFound desc = could not find container \"6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec\": container with ID starting with 6a0986cf891d11bd38fcf24a9142a75dff169627926aa9d11d70df257d167aec not found: ID does not exist" Jun 07 16:13:20.490840 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.490790 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nbg5"] Jun 07 16:13:20.493128 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:20.493090 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nbg5"] Jun 07 16:13:21.884054 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:21.884019 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d98478cc-12cd-4bfa-842d-779ce2b05ef2" path="/var/lib/kubelet/pods/d98478cc-12cd-4bfa-842d-779ce2b05ef2/volumes" Jun 07 16:13:32.051802 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:32.051767 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:32.152404 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:32.152355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:32.508158 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:32.508125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:42.423304 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:42.423220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:42.521536 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:42.521500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:42.658867 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:42.658800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:13:43.531362 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:13:43.531325 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:05.682805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:05.682772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:05.783794 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:05.783762 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:06.180837 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.180801 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:14:06.181131 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.181116 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98478cc-12cd-4bfa-842d-779ce2b05ef2" containerName="authorino" Jun 07 16:14:06.181180 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.181132 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98478cc-12cd-4bfa-842d-779ce2b05ef2" containerName="authorino" Jun 07 16:14:06.181180 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.181174 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98478cc-12cd-4bfa-842d-779ce2b05ef2" containerName="authorino" Jun 07 16:14:06.184193 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.184175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:06.186985 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.186961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-5b8sx\"" Jun 07 16:14:06.187099 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.186961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 07 16:14:06.187099 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.186961 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 16:14:06.187846 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.187815 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 16:14:06.192920 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.192898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:14:06.349817 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.349780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c697\" (UniqueName: \"kubernetes.io/projected/b693a381-3cc0-438f-92d4-6a9e436fe2cc-kube-api-access-8c697\") pod \"maas-keycloak-0\" (UID: \"b693a381-3cc0-438f-92d4-6a9e436fe2cc\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:06.450243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.450211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c697\" (UniqueName: \"kubernetes.io/projected/b693a381-3cc0-438f-92d4-6a9e436fe2cc-kube-api-access-8c697\") pod \"maas-keycloak-0\" (UID: \"b693a381-3cc0-438f-92d4-6a9e436fe2cc\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:06.458435 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.458408 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c697\" (UniqueName: \"kubernetes.io/projected/b693a381-3cc0-438f-92d4-6a9e436fe2cc-kube-api-access-8c697\") pod \"maas-keycloak-0\" (UID: \"b693a381-3cc0-438f-92d4-6a9e436fe2cc\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:06.494390 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.494357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:06.629623 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.629547 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:14:06.632182 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:14:06.632151 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb693a381_3cc0_438f_92d4_6a9e436fe2cc.slice/crio-b9bb5e5129929bc08d01b452437d42c1a202090265671fdef239c0ca53037150 WatchSource:0}: Error finding container b9bb5e5129929bc08d01b452437d42c1a202090265671fdef239c0ca53037150: Status 404 returned error can't find the container with id b9bb5e5129929bc08d01b452437d42c1a202090265671fdef239c0ca53037150 Jun 07 16:14:06.655842 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:06.655800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b693a381-3cc0-438f-92d4-6a9e436fe2cc","Type":"ContainerStarted","Data":"b9bb5e5129929bc08d01b452437d42c1a202090265671fdef239c0ca53037150"} Jun 07 16:14:12.686122 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:12.686084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b693a381-3cc0-438f-92d4-6a9e436fe2cc","Type":"ContainerStarted","Data":"2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a"} Jun 07 16:14:12.703019 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:12.702958 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.379786322 podStartE2EDuration="6.702938953s" totalImagesPullingTime="5.323152631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:14:12.702780634 +0000 UTC m=+745.288619049" watchObservedRunningTime="2026-06-07 16:14:12.702938953 +0000 UTC m=+745.288777373" Jun 07 16:14:13.494703 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:13.494661 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:13.496872 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:13.496807 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:14.495302 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:14.495240 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:15.495806 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:15.495747 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:16.496913 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:16.495592 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:16.496913 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:16.496448 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:17.495529 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:17.495315 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:18.495642 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:18.495587 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:19.495351 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:19.495298 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:20.495575 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:20.495524 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:21.495222 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:21.495175 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:22.495066 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:22.495017 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:23.495472 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:23.495423 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:24.495201 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:24.495147 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:25.494791 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:25.494742 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.20:9000/health/started\": dial tcp 10.132.0.20:9000: connect: connection refused" Jun 07 16:14:26.627804 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:26.627741 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:26.647690 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:26.647633 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:14:36.634315 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:36.634281 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:14:37.265062 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.265024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:37.486456 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.486423 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tdr4p"] Jun 07 16:14:37.493274 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.493254 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:37.495649 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.495625 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tdr4p"] Jun 07 16:14:37.560724 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.560628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:37.606703 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.606673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq28d\" (UniqueName: \"kubernetes.io/projected/993b98fd-6c8b-4a34-ad09-02d1a80e236b-kube-api-access-pq28d\") pod \"authorino-5d4b67c446-tdr4p\" (UID: \"993b98fd-6c8b-4a34-ad09-02d1a80e236b\") " pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:37.708041 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.707999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq28d\" (UniqueName: \"kubernetes.io/projected/993b98fd-6c8b-4a34-ad09-02d1a80e236b-kube-api-access-pq28d\") pod \"authorino-5d4b67c446-tdr4p\" (UID: \"993b98fd-6c8b-4a34-ad09-02d1a80e236b\") " pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:37.710145 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.710115 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tdr4p"] Jun 07 16:14:37.710347 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:14:37.710330 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pq28d], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-tdr4p" podUID="993b98fd-6c8b-4a34-ad09-02d1a80e236b" Jun 07 16:14:37.725489 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.725461 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq28d\" (UniqueName: \"kubernetes.io/projected/993b98fd-6c8b-4a34-ad09-02d1a80e236b-kube-api-access-pq28d\") pod \"authorino-5d4b67c446-tdr4p\" (UID: \"993b98fd-6c8b-4a34-ad09-02d1a80e236b\") " pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:37.766250 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.766216 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fd6bcf95d-4mmsv"] Jun 07 16:14:37.768304 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.768286 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:37.770808 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.770788 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 07 16:14:37.776771 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.776746 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fd6bcf95d-4mmsv"] Jun 07 16:14:37.808529 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.808490 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrpj\" (UniqueName: \"kubernetes.io/projected/5e636da5-aef7-4da5-aecc-95075f4680b3-kube-api-access-hhrpj\") pod \"authorino-6fd6bcf95d-4mmsv\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:37.808707 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.808550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e636da5-aef7-4da5-aecc-95075f4680b3-tls-cert\") pod \"authorino-6fd6bcf95d-4mmsv\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:37.818737 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.818661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:37.824171 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.824149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:37.909883 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.909845 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq28d\" (UniqueName: \"kubernetes.io/projected/993b98fd-6c8b-4a34-ad09-02d1a80e236b-kube-api-access-pq28d\") pod \"993b98fd-6c8b-4a34-ad09-02d1a80e236b\" (UID: \"993b98fd-6c8b-4a34-ad09-02d1a80e236b\") " Jun 07 16:14:37.910049 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.909967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrpj\" (UniqueName: \"kubernetes.io/projected/5e636da5-aef7-4da5-aecc-95075f4680b3-kube-api-access-hhrpj\") pod \"authorino-6fd6bcf95d-4mmsv\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:37.910049 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.910003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e636da5-aef7-4da5-aecc-95075f4680b3-tls-cert\") pod \"authorino-6fd6bcf95d-4mmsv\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:37.912052 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.912020 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/993b98fd-6c8b-4a34-ad09-02d1a80e236b-kube-api-access-pq28d" (OuterVolumeSpecName: "kube-api-access-pq28d") pod "993b98fd-6c8b-4a34-ad09-02d1a80e236b" (UID: "993b98fd-6c8b-4a34-ad09-02d1a80e236b"). InnerVolumeSpecName "kube-api-access-pq28d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:14:37.912220 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.912202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e636da5-aef7-4da5-aecc-95075f4680b3-tls-cert\") pod \"authorino-6fd6bcf95d-4mmsv\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:37.918031 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:37.918007 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrpj\" (UniqueName: \"kubernetes.io/projected/5e636da5-aef7-4da5-aecc-95075f4680b3-kube-api-access-hhrpj\") pod \"authorino-6fd6bcf95d-4mmsv\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:38.010443 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.010410 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq28d\" (UniqueName: \"kubernetes.io/projected/993b98fd-6c8b-4a34-ad09-02d1a80e236b-kube-api-access-pq28d\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:14:38.077939 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.077812 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:14:38.204395 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.204323 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fd6bcf95d-4mmsv"] Jun 07 16:14:38.206593 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:14:38.206542 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e636da5_aef7_4da5_aecc_95075f4680b3.slice/crio-fec2b89ecb42ed2d790efac84cee2b1e3e0ecfc6cab85d3f8b0afc91b708c0c4 WatchSource:0}: Error finding container fec2b89ecb42ed2d790efac84cee2b1e3e0ecfc6cab85d3f8b0afc91b708c0c4: Status 404 returned error can't find the container with id fec2b89ecb42ed2d790efac84cee2b1e3e0ecfc6cab85d3f8b0afc91b708c0c4 Jun 07 16:14:38.824252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.824208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" event={"ID":"5e636da5-aef7-4da5-aecc-95075f4680b3","Type":"ContainerStarted","Data":"ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc"} Jun 07 16:14:38.824252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.824238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tdr4p" Jun 07 16:14:38.824252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.824259 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" event={"ID":"5e636da5-aef7-4da5-aecc-95075f4680b3","Type":"ContainerStarted","Data":"fec2b89ecb42ed2d790efac84cee2b1e3e0ecfc6cab85d3f8b0afc91b708c0c4"} Jun 07 16:14:38.842377 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.842312 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" podStartSLOduration=1.4480327929999999 podStartE2EDuration="1.842291905s" totalImagesPullingTime="394.259112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:14:38.841952906 +0000 UTC m=+771.427791348" watchObservedRunningTime="2026-06-07 16:14:38.842291905 +0000 UTC m=+771.428130321" Jun 07 16:14:38.865405 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.865315 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tdr4p"] Jun 07 16:14:38.873228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.873189 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gj9cj"] Jun 07 16:14:38.873404 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.873380 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gj9cj" podUID="3c652512-91d5-472b-a49c-e5fc7fb4f69f" containerName="authorino" containerID="cri-o://2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3" gracePeriod=30 Jun 07 16:14:38.875039 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:38.875013 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tdr4p"] Jun 07 16:14:39.120073 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.120009 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:14:39.218483 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.218437 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trwcw\" (UniqueName: \"kubernetes.io/projected/3c652512-91d5-472b-a49c-e5fc7fb4f69f-kube-api-access-trwcw\") pod \"3c652512-91d5-472b-a49c-e5fc7fb4f69f\" (UID: \"3c652512-91d5-472b-a49c-e5fc7fb4f69f\") " Jun 07 16:14:39.220472 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.220435 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c652512-91d5-472b-a49c-e5fc7fb4f69f-kube-api-access-trwcw" (OuterVolumeSpecName: "kube-api-access-trwcw") pod "3c652512-91d5-472b-a49c-e5fc7fb4f69f" (UID: "3c652512-91d5-472b-a49c-e5fc7fb4f69f"). InnerVolumeSpecName "kube-api-access-trwcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:14:39.319122 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.319084 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trwcw\" (UniqueName: \"kubernetes.io/projected/3c652512-91d5-472b-a49c-e5fc7fb4f69f-kube-api-access-trwcw\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:14:39.829076 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.829033 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c652512-91d5-472b-a49c-e5fc7fb4f69f" containerID="2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3" exitCode=0 Jun 07 16:14:39.829540 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.829095 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gj9cj" Jun 07 16:14:39.829540 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.829117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gj9cj" event={"ID":"3c652512-91d5-472b-a49c-e5fc7fb4f69f","Type":"ContainerDied","Data":"2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3"} Jun 07 16:14:39.829540 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.829164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gj9cj" event={"ID":"3c652512-91d5-472b-a49c-e5fc7fb4f69f","Type":"ContainerDied","Data":"9d4644a72e98cd01b2d1c20025199d4e2e153873dac6e3b96e7593408df132ac"} Jun 07 16:14:39.829540 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.829187 2572 scope.go:117] "RemoveContainer" containerID="2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3" Jun 07 16:14:39.837507 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.837486 2572 scope.go:117] "RemoveContainer" containerID="2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3" Jun 07 16:14:39.837778 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:14:39.837758 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3\": container with ID starting with 2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3 not found: ID does not exist" containerID="2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3" Jun 07 16:14:39.837845 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.837787 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3"} err="failed to get container status \"2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3\": rpc error: code = NotFound desc = could not find container \"2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3\": container with ID starting with 2378453ce9879f7283a716af0a4c359765c0c8c2e7251ba38db442137d8637f3 not found: ID does not exist" Jun 07 16:14:39.848704 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.848682 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gj9cj"] Jun 07 16:14:39.850584 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.850566 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gj9cj"] Jun 07 16:14:39.884440 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.884414 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c652512-91d5-472b-a49c-e5fc7fb4f69f" path="/var/lib/kubelet/pods/3c652512-91d5-472b-a49c-e5fc7fb4f69f/volumes" Jun 07 16:14:39.884715 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:39.884703 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="993b98fd-6c8b-4a34-ad09-02d1a80e236b" path="/var/lib/kubelet/pods/993b98fd-6c8b-4a34-ad09-02d1a80e236b/volumes" Jun 07 16:14:42.518883 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.518839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:42.525528 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.525499 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66849674bf-k6jsp"] Jun 07 16:14:42.525764 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.525753 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c652512-91d5-472b-a49c-e5fc7fb4f69f" containerName="authorino" Jun 07 16:14:42.525805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.525765 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c652512-91d5-472b-a49c-e5fc7fb4f69f" containerName="authorino" Jun 07 16:14:42.525856 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.525851 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c652512-91d5-472b-a49c-e5fc7fb4f69f" containerName="authorino" Jun 07 16:14:42.528568 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.528550 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:42.530779 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.530758 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 16:14:42.531040 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.531024 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 16:14:42.531088 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.531047 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6rmzg\"" Jun 07 16:14:42.539525 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.539499 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66849674bf-k6jsp"] Jun 07 16:14:42.617969 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.617923 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:42.644016 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.643985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qjm\" (UniqueName: \"kubernetes.io/projected/9ec2ece5-ce5d-4fdc-864a-716d537a5797-kube-api-access-42qjm\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:42.644137 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.644027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:42.694694 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.694661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:42.699738 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.698232 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-qzlc9"] Jun 07 16:14:42.701671 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.701651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.711848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.711803 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-qzlc9"] Jun 07 16:14:42.744615 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.744574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qjm\" (UniqueName: \"kubernetes.io/projected/9ec2ece5-ce5d-4fdc-864a-716d537a5797-kube-api-access-42qjm\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:42.744862 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.744622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-webhook-cert\") pod \"maas-controller-66c69d6dc7-qzlc9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.744862 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.744655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:42.744862 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.744716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8clnz\" (UniqueName: \"kubernetes.io/projected/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-kube-api-access-8clnz\") pod \"maas-controller-66c69d6dc7-qzlc9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.745030 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:14:42.744866 2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 07 16:14:42.745030 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:14:42.744965 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert podName:9ec2ece5-ce5d-4fdc-864a-716d537a5797 nodeName:}" failed. No retries permitted until 2026-06-07 16:14:43.24494055 +0000 UTC m=+775.830778947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert") pod "maas-controller-66849674bf-k6jsp" (UID: "9ec2ece5-ce5d-4fdc-864a-716d537a5797") : secret "maas-controller-webhook-cert" not found Jun 07 16:14:42.753431 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.753402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qjm\" (UniqueName: \"kubernetes.io/projected/9ec2ece5-ce5d-4fdc-864a-716d537a5797-kube-api-access-42qjm\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:42.845593 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.845503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8clnz\" (UniqueName: \"kubernetes.io/projected/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-kube-api-access-8clnz\") pod \"maas-controller-66c69d6dc7-qzlc9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.845593 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.845549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-webhook-cert\") pod \"maas-controller-66c69d6dc7-qzlc9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.847944 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.847921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-webhook-cert\") pod \"maas-controller-66c69d6dc7-qzlc9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.854165 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.854139 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8clnz\" (UniqueName: \"kubernetes.io/projected/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-kube-api-access-8clnz\") pod \"maas-controller-66c69d6dc7-qzlc9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:42.856819 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:42.856774 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:43.011488 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.011444 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:43.140164 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.140071 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-qzlc9"] Jun 07 16:14:43.142676 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:14:43.142652 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3d8e43_6011_44d9_8b6c_2fd060e38bd9.slice/crio-39de8cdbaa0a77924ab4417579e379a3b5c4a5d531dd101bc13cd07d564d9b22 WatchSource:0}: Error finding container 39de8cdbaa0a77924ab4417579e379a3b5c4a5d531dd101bc13cd07d564d9b22: Status 404 returned error can't find the container with id 39de8cdbaa0a77924ab4417579e379a3b5c4a5d531dd101bc13cd07d564d9b22 Jun 07 16:14:43.248301 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.248267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:43.250739 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.250717 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert\") pod \"maas-controller-66849674bf-k6jsp\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:43.439263 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.439167 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:43.565689 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.565663 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66849674bf-k6jsp"] Jun 07 16:14:43.567872 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:14:43.567844 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec2ece5_ce5d_4fdc_864a_716d537a5797.slice/crio-2248d92e5d64d5a543b9a3bc1ca1f7f36001fe663aae74748fe97c51ccd2b597 WatchSource:0}: Error finding container 2248d92e5d64d5a543b9a3bc1ca1f7f36001fe663aae74748fe97c51ccd2b597: Status 404 returned error can't find the container with id 2248d92e5d64d5a543b9a3bc1ca1f7f36001fe663aae74748fe97c51ccd2b597 Jun 07 16:14:43.849360 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.849321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" event={"ID":"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9","Type":"ContainerStarted","Data":"39de8cdbaa0a77924ab4417579e379a3b5c4a5d531dd101bc13cd07d564d9b22"} Jun 07 16:14:43.850634 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:43.850600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66849674bf-k6jsp" event={"ID":"9ec2ece5-ce5d-4fdc-864a-716d537a5797","Type":"ContainerStarted","Data":"2248d92e5d64d5a543b9a3bc1ca1f7f36001fe663aae74748fe97c51ccd2b597"} Jun 07 16:14:45.979475 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:45.979432 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:46.077424 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.077330 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:46.871428 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.871391 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66849674bf-k6jsp" event={"ID":"9ec2ece5-ce5d-4fdc-864a-716d537a5797","Type":"ContainerStarted","Data":"afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974"} Jun 07 16:14:46.871633 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.871510 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:46.872817 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.872786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" event={"ID":"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9","Type":"ContainerStarted","Data":"44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1"} Jun 07 16:14:46.872954 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.872861 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:46.887106 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.887051 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66849674bf-k6jsp" podStartSLOduration=2.640710993 podStartE2EDuration="4.887036057s" totalImagesPullingTime="2.246325064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:14:46.886202609 +0000 UTC m=+779.472041022" watchObservedRunningTime="2026-06-07 16:14:46.887036057 +0000 UTC m=+779.472874471" Jun 07 16:14:46.901945 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:46.901890 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" podStartSLOduration=2.237410483 podStartE2EDuration="4.901874666s" totalImagesPullingTime="2.664464183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:14:46.90135806 +0000 UTC m=+779.487196467" watchObservedRunningTime="2026-06-07 16:14:46.901874666 +0000 UTC m=+779.487713083" Jun 07 16:14:49.023143 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:49.023107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:49.075665 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:49.075635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:14:57.884091 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:57.884064 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:57.884506 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:57.884119 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:14:57.940031 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:57.940000 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66849674bf-k6jsp"] Jun 07 16:14:57.940226 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:57.940183 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-66849674bf-k6jsp" podUID="9ec2ece5-ce5d-4fdc-864a-716d537a5797" containerName="manager" containerID="cri-o://afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974" gracePeriod=30 Jun 07 16:14:58.182361 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.182336 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:58.270209 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.270166 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert\") pod \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " Jun 07 16:14:58.270400 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.270285 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42qjm\" (UniqueName: \"kubernetes.io/projected/9ec2ece5-ce5d-4fdc-864a-716d537a5797-kube-api-access-42qjm\") pod \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\" (UID: \"9ec2ece5-ce5d-4fdc-864a-716d537a5797\") " Jun 07 16:14:58.272404 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.272371 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9ec2ece5-ce5d-4fdc-864a-716d537a5797" (UID: "9ec2ece5-ce5d-4fdc-864a-716d537a5797"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:14:58.272517 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.272426 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec2ece5-ce5d-4fdc-864a-716d537a5797-kube-api-access-42qjm" (OuterVolumeSpecName: "kube-api-access-42qjm") pod "9ec2ece5-ce5d-4fdc-864a-716d537a5797" (UID: "9ec2ece5-ce5d-4fdc-864a-716d537a5797"). InnerVolumeSpecName "kube-api-access-42qjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:14:58.375479 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.375434 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42qjm\" (UniqueName: \"kubernetes.io/projected/9ec2ece5-ce5d-4fdc-864a-716d537a5797-kube-api-access-42qjm\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:14:58.375479 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.375477 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ec2ece5-ce5d-4fdc-864a-716d537a5797-webhook-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:14:58.921930 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.921892 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ec2ece5-ce5d-4fdc-864a-716d537a5797" containerID="afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974" exitCode=0 Jun 07 16:14:58.922450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.921943 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66849674bf-k6jsp" Jun 07 16:14:58.922450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.921971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66849674bf-k6jsp" event={"ID":"9ec2ece5-ce5d-4fdc-864a-716d537a5797","Type":"ContainerDied","Data":"afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974"} Jun 07 16:14:58.922450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.922023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66849674bf-k6jsp" event={"ID":"9ec2ece5-ce5d-4fdc-864a-716d537a5797","Type":"ContainerDied","Data":"2248d92e5d64d5a543b9a3bc1ca1f7f36001fe663aae74748fe97c51ccd2b597"} Jun 07 16:14:58.922450 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.922057 2572 scope.go:117] "RemoveContainer" containerID="afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974" Jun 07 16:14:58.931013 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.930997 2572 scope.go:117] "RemoveContainer" containerID="afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974" Jun 07 16:14:58.931283 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:14:58.931265 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974\": container with ID starting with afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974 not found: ID does not exist" containerID="afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974" Jun 07 16:14:58.931316 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.931294 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974"} err="failed to get container status \"afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974\": rpc error: code = NotFound desc = could not find container \"afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974\": container with ID starting with afdae94873fa9ae95dda6826fcd5d6771f78cdd0a6ec8329a9e293f1a92cd974 not found: ID does not exist" Jun 07 16:14:58.941604 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.941580 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66849674bf-k6jsp"] Jun 07 16:14:58.944800 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:58.944782 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66849674bf-k6jsp"] Jun 07 16:14:59.884238 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:14:59.884207 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec2ece5-ce5d-4fdc-864a-716d537a5797" path="/var/lib/kubelet/pods/9ec2ece5-ce5d-4fdc-864a-716d537a5797/volumes" Jun 07 16:15:17.700324 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.700233 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:17.744775 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.744743 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-845f598fff-4wns7"] Jun 07 16:15:17.745059 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.745047 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec2ece5-ce5d-4fdc-864a-716d537a5797" containerName="manager" Jun 07 16:15:17.745105 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.745062 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec2ece5-ce5d-4fdc-864a-716d537a5797" containerName="manager" Jun 07 16:15:17.745143 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.745114 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec2ece5-ce5d-4fdc-864a-716d537a5797" containerName="manager" Jun 07 16:15:17.747986 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.747969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:17.750263 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.750241 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 07 16:15:17.750263 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.750256 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-8zztb\"" Jun 07 16:15:17.751255 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.751236 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 07 16:15:17.751535 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.751514 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 07 16:15:17.760966 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.760941 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-845f598fff-4wns7"] Jun 07 16:15:17.932444 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.932403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvscl\" (UniqueName: \"kubernetes.io/projected/a4871ea7-f63f-448c-a7e9-58abc28d5cee-kube-api-access-rvscl\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:17.932629 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:17.932488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4871ea7-f63f-448c-a7e9-58abc28d5cee-maas-api-tls\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.033091 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.033004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvscl\" (UniqueName: \"kubernetes.io/projected/a4871ea7-f63f-448c-a7e9-58abc28d5cee-kube-api-access-rvscl\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.033271 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.033103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4871ea7-f63f-448c-a7e9-58abc28d5cee-maas-api-tls\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.033271 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:15:18.033224 2572 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 07 16:15:18.033394 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:15:18.033299 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4871ea7-f63f-448c-a7e9-58abc28d5cee-maas-api-tls podName:a4871ea7-f63f-448c-a7e9-58abc28d5cee nodeName:}" failed. No retries permitted until 2026-06-07 16:15:18.533275936 +0000 UTC m=+811.119114329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4871ea7-f63f-448c-a7e9-58abc28d5cee-maas-api-tls") pod "maas-api-845f598fff-4wns7" (UID: "a4871ea7-f63f-448c-a7e9-58abc28d5cee") : secret "maas-api-serving-cert" not found Jun 07 16:15:18.044667 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.044642 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvscl\" (UniqueName: \"kubernetes.io/projected/a4871ea7-f63f-448c-a7e9-58abc28d5cee-kube-api-access-rvscl\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.148904 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.148871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:18.248112 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.248079 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-d7jt7"] Jun 07 16:15:18.251428 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.251400 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:18.252378 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.252347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:18.253763 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.253742 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 07 16:15:18.253763 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.253744 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c5c76\"" Jun 07 16:15:18.261286 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.261257 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-d7jt7"] Jun 07 16:15:18.268651 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.268628 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fkmqx"] Jun 07 16:15:18.271556 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.271541 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:18.281493 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.281466 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fkmqx"] Jun 07 16:15:18.377560 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.377476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:18.437244 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.437209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqqcj\" (UniqueName: \"kubernetes.io/projected/ad4bc12d-8f61-44e1-b2be-d7aea82885f8-kube-api-access-bqqcj\") pod \"payload-processing-7c6c859784-fkmqx\" (UID: \"ad4bc12d-8f61-44e1-b2be-d7aea82885f8\") " pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:18.437244 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.437248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzkrg\" (UniqueName: \"kubernetes.io/projected/8a922ce3-79ad-44df-82b8-911408e2f001-kube-api-access-pzkrg\") pod \"payload-pre-processing-67d7689b65-d7jt7\" (UID: \"8a922ce3-79ad-44df-82b8-911408e2f001\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:18.537874 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.537811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqqcj\" (UniqueName: \"kubernetes.io/projected/ad4bc12d-8f61-44e1-b2be-d7aea82885f8-kube-api-access-bqqcj\") pod \"payload-processing-7c6c859784-fkmqx\" (UID: \"ad4bc12d-8f61-44e1-b2be-d7aea82885f8\") " pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:18.538046 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.537890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzkrg\" (UniqueName: \"kubernetes.io/projected/8a922ce3-79ad-44df-82b8-911408e2f001-kube-api-access-pzkrg\") pod \"payload-pre-processing-67d7689b65-d7jt7\" (UID: \"8a922ce3-79ad-44df-82b8-911408e2f001\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:18.538046 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.537929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4871ea7-f63f-448c-a7e9-58abc28d5cee-maas-api-tls\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.540451 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.540423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4871ea7-f63f-448c-a7e9-58abc28d5cee-maas-api-tls\") pod \"maas-api-845f598fff-4wns7\" (UID: \"a4871ea7-f63f-448c-a7e9-58abc28d5cee\") " pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.545448 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.545414 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzkrg\" (UniqueName: \"kubernetes.io/projected/8a922ce3-79ad-44df-82b8-911408e2f001-kube-api-access-pzkrg\") pod \"payload-pre-processing-67d7689b65-d7jt7\" (UID: \"8a922ce3-79ad-44df-82b8-911408e2f001\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:18.545580 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.545557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqqcj\" (UniqueName: \"kubernetes.io/projected/ad4bc12d-8f61-44e1-b2be-d7aea82885f8-kube-api-access-bqqcj\") pod \"payload-processing-7c6c859784-fkmqx\" (UID: \"ad4bc12d-8f61-44e1-b2be-d7aea82885f8\") " pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:18.563256 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.563218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:18.582390 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.582357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:18.658818 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.658536 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:18.714141 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.714108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-d7jt7"] Jun 07 16:15:18.719987 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:15:18.719957 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a922ce3_79ad_44df_82b8_911408e2f001.slice/crio-640b87b98b7de7ac268cdbf4fd9417181337bbcaadecde48843dc594c90ffc95 WatchSource:0}: Error finding container 640b87b98b7de7ac268cdbf4fd9417181337bbcaadecde48843dc594c90ffc95: Status 404 returned error can't find the container with id 640b87b98b7de7ac268cdbf4fd9417181337bbcaadecde48843dc594c90ffc95 Jun 07 16:15:18.722403 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.722383 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:15:18.733764 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.733745 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fkmqx"] Jun 07 16:15:18.736400 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:15:18.736373 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4bc12d_8f61_44e1_b2be_d7aea82885f8.slice/crio-f006654aff70d6aed5742a99348c7de68e791f0b031b0964b869139b95b7015d WatchSource:0}: Error finding container f006654aff70d6aed5742a99348c7de68e791f0b031b0964b869139b95b7015d: Status 404 returned error can't find the container with id f006654aff70d6aed5742a99348c7de68e791f0b031b0964b869139b95b7015d Jun 07 16:15:18.798384 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:18.798358 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-845f598fff-4wns7"] Jun 07 16:15:18.801056 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:15:18.801021 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4871ea7_f63f_448c_a7e9_58abc28d5cee.slice/crio-f2bf2f89581a46b355f944b1943555cecc4345af461a705e3c6ab745951cf952 WatchSource:0}: Error finding container f2bf2f89581a46b355f944b1943555cecc4345af461a705e3c6ab745951cf952: Status 404 returned error can't find the container with id f2bf2f89581a46b355f944b1943555cecc4345af461a705e3c6ab745951cf952 Jun 07 16:15:19.007343 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:19.007297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" event={"ID":"8a922ce3-79ad-44df-82b8-911408e2f001","Type":"ContainerStarted","Data":"640b87b98b7de7ac268cdbf4fd9417181337bbcaadecde48843dc594c90ffc95"} Jun 07 16:15:19.008451 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:19.008425 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" event={"ID":"a4871ea7-f63f-448c-a7e9-58abc28d5cee","Type":"ContainerStarted","Data":"f2bf2f89581a46b355f944b1943555cecc4345af461a705e3c6ab745951cf952"} Jun 07 16:15:19.009562 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:19.009537 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" event={"ID":"ad4bc12d-8f61-44e1-b2be-d7aea82885f8","Type":"ContainerStarted","Data":"f006654aff70d6aed5742a99348c7de68e791f0b031b0964b869139b95b7015d"} Jun 07 16:15:21.021730 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.021679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" event={"ID":"8a922ce3-79ad-44df-82b8-911408e2f001","Type":"ContainerStarted","Data":"9b292ce05d16cf47405f108dba248482a4431461d9df76b4a20ae9d1fc0233fb"} Jun 07 16:15:21.022266 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.021846 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:21.023429 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.023398 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" event={"ID":"a4871ea7-f63f-448c-a7e9-58abc28d5cee","Type":"ContainerStarted","Data":"15779924957e69f9bdee51fb43bf7cdbee86165d0c63acab860ee2ab28e296c4"} Jun 07 16:15:21.023535 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.023490 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:21.025077 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.025054 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" event={"ID":"ad4bc12d-8f61-44e1-b2be-d7aea82885f8","Type":"ContainerStarted","Data":"e107bd63269cd724471acc85c4bc3e90ff476781dac4d7ff1ff1d5e7662db243"} Jun 07 16:15:21.025364 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.025186 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:21.037513 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.037471 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" podStartSLOduration=1.33230988 podStartE2EDuration="3.037454919s" totalImagesPullingTime="1.705145039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:15:21.035811108 +0000 UTC m=+813.621649523" watchObservedRunningTime="2026-06-07 16:15:21.037454919 +0000 UTC m=+813.623293334" Jun 07 16:15:21.051343 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.051281 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" podStartSLOduration=2.428327442 podStartE2EDuration="4.051259589s" totalImagesPullingTime="1.622932147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:15:21.049602109 +0000 UTC m=+813.635440525" watchObservedRunningTime="2026-06-07 16:15:21.051259589 +0000 UTC m=+813.637098006" Jun 07 16:15:21.068549 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:21.068499 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" podStartSLOduration=1.381358606 podStartE2EDuration="3.068482314s" totalImagesPullingTime="1.687123708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:15:21.066879401 +0000 UTC m=+813.652717817" watchObservedRunningTime="2026-06-07 16:15:21.068482314 +0000 UTC m=+813.654320774" Jun 07 16:15:27.033862 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:27.033814 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-845f598fff-4wns7" Jun 07 16:15:28.864295 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:28.864255 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:15:28.864690 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:28.864472 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" containerID="cri-o://2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a" gracePeriod=30 Jun 07 16:15:30.913813 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:30.913786 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:30.930048 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:30.930008 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c697\" (UniqueName: \"kubernetes.io/projected/b693a381-3cc0-438f-92d4-6a9e436fe2cc-kube-api-access-8c697\") pod \"b693a381-3cc0-438f-92d4-6a9e436fe2cc\" (UID: \"b693a381-3cc0-438f-92d4-6a9e436fe2cc\") " Jun 07 16:15:30.932644 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:30.932610 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b693a381-3cc0-438f-92d4-6a9e436fe2cc-kube-api-access-8c697" (OuterVolumeSpecName: "kube-api-access-8c697") pod "b693a381-3cc0-438f-92d4-6a9e436fe2cc" (UID: "b693a381-3cc0-438f-92d4-6a9e436fe2cc"). InnerVolumeSpecName "kube-api-access-8c697". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:15:31.030706 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.030616 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c697\" (UniqueName: \"kubernetes.io/projected/b693a381-3cc0-438f-92d4-6a9e436fe2cc-kube-api-access-8c697\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:15:31.065906 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.065869 2572 generic.go:356] "Generic (PLEG): container finished" podID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerID="2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a" exitCode=143 Jun 07 16:15:31.066097 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.065919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b693a381-3cc0-438f-92d4-6a9e436fe2cc","Type":"ContainerDied","Data":"2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a"} Jun 07 16:15:31.066097 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.065958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b693a381-3cc0-438f-92d4-6a9e436fe2cc","Type":"ContainerDied","Data":"b9bb5e5129929bc08d01b452437d42c1a202090265671fdef239c0ca53037150"} Jun 07 16:15:31.066097 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.065979 2572 scope.go:117] "RemoveContainer" containerID="2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a" Jun 07 16:15:31.066097 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.065919 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.076176 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.076155 2572 scope.go:117] "RemoveContainer" containerID="2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a" Jun 07 16:15:31.076497 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:15:31.076479 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a\": container with ID starting with 2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a not found: ID does not exist" containerID="2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a" Jun 07 16:15:31.076547 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.076507 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a"} err="failed to get container status \"2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a\": rpc error: code = NotFound desc = could not find container \"2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a\": container with ID starting with 2abf0cf505cb614583e297adfd3c7783f1a41de72b2264851e3ce8db73b3fc9a not found: ID does not exist" Jun 07 16:15:31.089701 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.089667 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:15:31.091439 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.091401 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:15:31.111324 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.111294 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:15:31.111626 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.111610 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" Jun 07 16:15:31.111626 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.111627 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" Jun 07 16:15:31.111747 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.111673 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" containerName="keycloak" Jun 07 16:15:31.115844 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.115808 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.118208 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.118179 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 07 16:15:31.118208 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.118208 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-5b8sx\"" Jun 07 16:15:31.118405 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.118317 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 07 16:15:31.118449 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.118419 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 16:15:31.118496 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.118463 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 16:15:31.125176 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.125154 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:15:31.131644 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.131388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cl5s\" (UniqueName: \"kubernetes.io/projected/0d4ce1d1-9e62-4cfc-a174-114f46af3221-kube-api-access-8cl5s\") pod \"maas-keycloak-0\" (UID: \"0d4ce1d1-9e62-4cfc-a174-114f46af3221\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.131644 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.131461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0d4ce1d1-9e62-4cfc-a174-114f46af3221-test-realms\") pod \"maas-keycloak-0\" (UID: \"0d4ce1d1-9e62-4cfc-a174-114f46af3221\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.232821 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.232775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0d4ce1d1-9e62-4cfc-a174-114f46af3221-test-realms\") pod \"maas-keycloak-0\" (UID: \"0d4ce1d1-9e62-4cfc-a174-114f46af3221\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.233030 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.232898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cl5s\" (UniqueName: \"kubernetes.io/projected/0d4ce1d1-9e62-4cfc-a174-114f46af3221-kube-api-access-8cl5s\") pod \"maas-keycloak-0\" (UID: \"0d4ce1d1-9e62-4cfc-a174-114f46af3221\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.233578 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.233559 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0d4ce1d1-9e62-4cfc-a174-114f46af3221-test-realms\") pod \"maas-keycloak-0\" (UID: \"0d4ce1d1-9e62-4cfc-a174-114f46af3221\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.240666 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.240633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cl5s\" (UniqueName: \"kubernetes.io/projected/0d4ce1d1-9e62-4cfc-a174-114f46af3221-kube-api-access-8cl5s\") pod \"maas-keycloak-0\" (UID: \"0d4ce1d1-9e62-4cfc-a174-114f46af3221\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.452711 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.452682 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:31.584391 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.584356 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:15:31.587379 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:15:31.587337 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4ce1d1_9e62_4cfc_a174_114f46af3221.slice/crio-1448e37c826908ac6313d33d86b418870e06b371895d65a72166d5e254164117 WatchSource:0}: Error finding container 1448e37c826908ac6313d33d86b418870e06b371895d65a72166d5e254164117: Status 404 returned error can't find the container with id 1448e37c826908ac6313d33d86b418870e06b371895d65a72166d5e254164117 Jun 07 16:15:31.885927 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:31.885843 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b693a381-3cc0-438f-92d4-6a9e436fe2cc" path="/var/lib/kubelet/pods/b693a381-3cc0-438f-92d4-6a9e436fe2cc/volumes" Jun 07 16:15:32.031645 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.031610 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fkmqx" Jun 07 16:15:32.032091 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.031784 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-d7jt7" Jun 07 16:15:32.074745 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.074338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0d4ce1d1-9e62-4cfc-a174-114f46af3221","Type":"ContainerStarted","Data":"656f983027ef9ecf73e0de9c76978be45fb4d50659f1f25cd6fe167dbf5120d4"} Jun 07 16:15:32.074745 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.074403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0d4ce1d1-9e62-4cfc-a174-114f46af3221","Type":"ContainerStarted","Data":"1448e37c826908ac6313d33d86b418870e06b371895d65a72166d5e254164117"} Jun 07 16:15:32.093408 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.093340 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.788707241 podStartE2EDuration="1.093321008s" totalImagesPullingTime="304.613767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:15:32.092156025 +0000 UTC m=+824.677994464" watchObservedRunningTime="2026-06-07 16:15:32.093321008 +0000 UTC m=+824.679159424" Jun 07 16:15:32.453481 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.453436 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:32.455472 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:32.455432 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:33.453645 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:33.453595 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:34.454235 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:34.454177 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:35.454031 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:35.453970 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:36.453338 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:36.453274 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:37.453212 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:37.453164 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:38.454129 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:38.454084 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:39.453661 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:39.453615 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:40.454116 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:40.454075 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:41.453654 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:41.453621 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:41.454020 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:41.453976 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:42.335542 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:42.335498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:42.453523 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:42.453468 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:43.454243 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:43.454195 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:44.453328 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:44.453282 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 07 16:15:45.547627 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:45.547585 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 07 16:15:45.564228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:45.564186 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:15:51.782071 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:51.782018 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:51.882285 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:51.882247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:15:55.552395 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:15:55.552339 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0d4ce1d1-9e62-4cfc-a174-114f46af3221" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:16:05.553964 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:05.553932 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:16:16.214162 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.214124 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8656775d84-tkqdv"] Jun 07 16:16:16.217411 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.217386 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.219734 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.219709 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 07 16:16:16.225002 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.224888 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8656775d84-tkqdv"] Jun 07 16:16:16.235245 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.235214 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-oidc-ca\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.235395 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.235308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwvf\" (UniqueName: \"kubernetes.io/projected/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-kube-api-access-twwvf\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.235395 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.235373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-tls-cert\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.335755 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.335718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-oidc-ca\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.335982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.335764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwvf\" (UniqueName: \"kubernetes.io/projected/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-kube-api-access-twwvf\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.335982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.335796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-tls-cert\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.336533 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.336512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-oidc-ca\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.338207 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.338189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-tls-cert\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.343586 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.343553 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwvf\" (UniqueName: \"kubernetes.io/projected/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-kube-api-access-twwvf\") pod \"authorino-8656775d84-tkqdv\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.527910 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.527778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:16:16.662893 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:16.662857 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8656775d84-tkqdv"] Jun 07 16:16:16.666463 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:16:16.666435 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf8b7f7d_8ff0_480c_8c9c_21a11658b741.slice/crio-bb2107407d7729465c62b345aae23f57d9ef6e7d198c9440ed0eeaf854a2b0f2 WatchSource:0}: Error finding container bb2107407d7729465c62b345aae23f57d9ef6e7d198c9440ed0eeaf854a2b0f2: Status 404 returned error can't find the container with id bb2107407d7729465c62b345aae23f57d9ef6e7d198c9440ed0eeaf854a2b0f2 Jun 07 16:16:17.308775 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.308736 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8656775d84-tkqdv" event={"ID":"bf8b7f7d-8ff0-480c-8c9c-21a11658b741","Type":"ContainerStarted","Data":"27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa"} Jun 07 16:16:17.309298 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.308785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8656775d84-tkqdv" event={"ID":"bf8b7f7d-8ff0-480c-8c9c-21a11658b741","Type":"ContainerStarted","Data":"bb2107407d7729465c62b345aae23f57d9ef6e7d198c9440ed0eeaf854a2b0f2"} Jun 07 16:16:17.324129 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.324061 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8656775d84-tkqdv" podStartSLOduration=0.846147502 podStartE2EDuration="1.324040553s" totalImagesPullingTime="477.893051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:16:17.322473816 +0000 UTC m=+869.908312222" watchObservedRunningTime="2026-06-07 16:16:17.324040553 +0000 UTC m=+869.909878967" Jun 07 16:16:17.358276 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.358239 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fd6bcf95d-4mmsv"] Jun 07 16:16:17.358750 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.358693 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" podUID="5e636da5-aef7-4da5-aecc-95075f4680b3" containerName="authorino" containerID="cri-o://ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc" gracePeriod=30 Jun 07 16:16:17.618352 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.618323 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:16:17.646033 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.645997 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e636da5-aef7-4da5-aecc-95075f4680b3-tls-cert\") pod \"5e636da5-aef7-4da5-aecc-95075f4680b3\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " Jun 07 16:16:17.646228 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.646059 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhrpj\" (UniqueName: \"kubernetes.io/projected/5e636da5-aef7-4da5-aecc-95075f4680b3-kube-api-access-hhrpj\") pod \"5e636da5-aef7-4da5-aecc-95075f4680b3\" (UID: \"5e636da5-aef7-4da5-aecc-95075f4680b3\") " Jun 07 16:16:17.648250 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.648205 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e636da5-aef7-4da5-aecc-95075f4680b3-kube-api-access-hhrpj" (OuterVolumeSpecName: "kube-api-access-hhrpj") pod "5e636da5-aef7-4da5-aecc-95075f4680b3" (UID: "5e636da5-aef7-4da5-aecc-95075f4680b3"). InnerVolumeSpecName "kube-api-access-hhrpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:16:17.655644 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.655613 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e636da5-aef7-4da5-aecc-95075f4680b3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5e636da5-aef7-4da5-aecc-95075f4680b3" (UID: "5e636da5-aef7-4da5-aecc-95075f4680b3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:16:17.747620 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.747524 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e636da5-aef7-4da5-aecc-95075f4680b3-tls-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:16:17.747620 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.747566 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhrpj\" (UniqueName: \"kubernetes.io/projected/5e636da5-aef7-4da5-aecc-95075f4680b3-kube-api-access-hhrpj\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:16:17.764156 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:17.764120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:16:18.314699 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.314658 2572 generic.go:356] "Generic (PLEG): container finished" podID="5e636da5-aef7-4da5-aecc-95075f4680b3" containerID="ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc" exitCode=0 Jun 07 16:16:18.315217 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.314730 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" Jun 07 16:16:18.315217 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.314731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" event={"ID":"5e636da5-aef7-4da5-aecc-95075f4680b3","Type":"ContainerDied","Data":"ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc"} Jun 07 16:16:18.315217 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.314773 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd6bcf95d-4mmsv" event={"ID":"5e636da5-aef7-4da5-aecc-95075f4680b3","Type":"ContainerDied","Data":"fec2b89ecb42ed2d790efac84cee2b1e3e0ecfc6cab85d3f8b0afc91b708c0c4"} Jun 07 16:16:18.315217 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.314798 2572 scope.go:117] "RemoveContainer" containerID="ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc" Jun 07 16:16:18.322802 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.322785 2572 scope.go:117] "RemoveContainer" containerID="ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc" Jun 07 16:16:18.323197 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:16:18.323178 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc\": container with ID starting with ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc not found: ID does not exist" containerID="ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc" Jun 07 16:16:18.323262 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.323205 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc"} err="failed to get container status \"ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc\": rpc error: code = NotFound desc = could not find container \"ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc\": container with ID starting with ffa7c5fa721243e75d6835fcf0ee07f1ca5213b51e427d291c5a90c37dd1c9cc not found: ID does not exist" Jun 07 16:16:18.330213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.330172 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fd6bcf95d-4mmsv"] Jun 07 16:16:18.333533 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.333513 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6fd6bcf95d-4mmsv"] Jun 07 16:16:18.976428 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:18.976396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:16:19.884269 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:19.884227 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e636da5-aef7-4da5-aecc-95075f4680b3" path="/var/lib/kubelet/pods/5e636da5-aef7-4da5-aecc-95075f4680b3/volumes" Jun 07 16:16:30.082991 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:30.082952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:16:39.073550 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.073473 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq"] Jun 07 16:16:39.073992 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.073962 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e636da5-aef7-4da5-aecc-95075f4680b3" containerName="authorino" Jun 07 16:16:39.073992 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.073981 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e636da5-aef7-4da5-aecc-95075f4680b3" containerName="authorino" Jun 07 16:16:39.074100 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.074059 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e636da5-aef7-4da5-aecc-95075f4680b3" containerName="authorino" Jun 07 16:16:39.078723 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.078704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.081183 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.081162 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 16:16:39.082132 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.082114 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nddxh\"" Jun 07 16:16:39.082197 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.082128 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 07 16:16:39.082197 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.082188 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 16:16:39.088421 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.088396 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq"] Jun 07 16:16:39.103340 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.103306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:16:39.114451 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.114420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.114552 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.114471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1fe890b-b71e-419c-8f12-edebed03267c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.114602 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.114573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.114680 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.114661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.114745 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.114698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.114862 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.114814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhpx\" (UniqueName: \"kubernetes.io/projected/d1fe890b-b71e-419c-8f12-edebed03267c-kube-api-access-wmhpx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216151 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1fe890b-b71e-419c-8f12-edebed03267c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216151 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216426 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216426 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216426 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhpx\" (UniqueName: \"kubernetes.io/projected/d1fe890b-b71e-419c-8f12-edebed03267c-kube-api-access-wmhpx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216426 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216652 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216707 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.216707 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.216686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.218462 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.218442 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1fe890b-b71e-419c-8f12-edebed03267c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.218797 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.218775 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1fe890b-b71e-419c-8f12-edebed03267c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.223876 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.223855 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhpx\" (UniqueName: \"kubernetes.io/projected/d1fe890b-b71e-419c-8f12-edebed03267c-kube-api-access-wmhpx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7nrsq\" (UID: \"d1fe890b-b71e-419c-8f12-edebed03267c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.405498 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.405411 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:16:39.546423 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:39.546393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq"] Jun 07 16:16:39.550178 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:16:39.550136 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fe890b_b71e_419c_8f12_edebed03267c.slice/crio-d73c0e4c42f213bc228209585ef0838db435692f758ddbaf3a97470a5b15074d WatchSource:0}: Error finding container d73c0e4c42f213bc228209585ef0838db435692f758ddbaf3a97470a5b15074d: Status 404 returned error can't find the container with id d73c0e4c42f213bc228209585ef0838db435692f758ddbaf3a97470a5b15074d Jun 07 16:16:40.408293 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:40.408252 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" event={"ID":"d1fe890b-b71e-419c-8f12-edebed03267c","Type":"ContainerStarted","Data":"d73c0e4c42f213bc228209585ef0838db435692f758ddbaf3a97470a5b15074d"} Jun 07 16:16:43.425775 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:43.425731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" event={"ID":"d1fe890b-b71e-419c-8f12-edebed03267c","Type":"ContainerStarted","Data":"e7258c1017f364ea2ec2f89399f015681ec44be88bbf3b34d154c8a0d0e3a03b"} Jun 07 16:16:47.150053 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:47.150020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:16:47.196044 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:47.196012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:16:47.863605 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:47.863578 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:16:47.868793 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:47.868764 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:16:53.284496 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:16:53.284457 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:17:11.019898 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:11.019818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:17:16.719613 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:16.719580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:17:36.653779 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:36.653741 2572 generic.go:356] "Generic (PLEG): container finished" podID="d1fe890b-b71e-419c-8f12-edebed03267c" containerID="e7258c1017f364ea2ec2f89399f015681ec44be88bbf3b34d154c8a0d0e3a03b" exitCode=0 Jun 07 16:17:36.654188 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:36.653816 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" event={"ID":"d1fe890b-b71e-419c-8f12-edebed03267c","Type":"ContainerDied","Data":"e7258c1017f364ea2ec2f89399f015681ec44be88bbf3b34d154c8a0d0e3a03b"} Jun 07 16:17:38.126251 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:38.126172 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:17:38.665573 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:38.665541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" event={"ID":"d1fe890b-b71e-419c-8f12-edebed03267c","Type":"ContainerStarted","Data":"ee5bbfc71f3afd4be4c3bf908e33fd9e56cd1185cc64a2c64f6e9019c468ce51"} Jun 07 16:17:38.684466 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:38.684414 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" podStartSLOduration=2.416713815 podStartE2EDuration="59.684397864s" totalImagesPullingTime="4.447832724s" totalInitContainerRuntime="52.819851325s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:16:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:17:38.683032702 +0000 UTC m=+951.268871118" watchObservedRunningTime="2026-06-07 16:17:38.684397864 +0000 UTC m=+951.270236278" Jun 07 16:17:39.406030 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:39.405996 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:17:39.406432 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:39.406054 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:17:39.419019 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:39.418982 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:17:39.682511 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:39.682402 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7nrsq" Jun 07 16:17:45.789502 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:17:45.789452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:18:17.583727 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.583643 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-769d9f4677-wwfvx"] Jun 07 16:18:17.588873 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.588820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.598868 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.598842 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769d9f4677-wwfvx"] Jun 07 16:18:17.736659 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.736615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f516c59-3618-4e8e-9c4b-bd8418a783a4-tls-cert\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.736902 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.736685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8f516c59-3618-4e8e-9c4b-bd8418a783a4-oidc-ca\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.736902 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.736739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tsgw\" (UniqueName: \"kubernetes.io/projected/8f516c59-3618-4e8e-9c4b-bd8418a783a4-kube-api-access-9tsgw\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.837393 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.837298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8f516c59-3618-4e8e-9c4b-bd8418a783a4-oidc-ca\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.837393 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.837365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tsgw\" (UniqueName: \"kubernetes.io/projected/8f516c59-3618-4e8e-9c4b-bd8418a783a4-kube-api-access-9tsgw\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.837578 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.837405 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f516c59-3618-4e8e-9c4b-bd8418a783a4-tls-cert\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.838113 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.838080 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8f516c59-3618-4e8e-9c4b-bd8418a783a4-oidc-ca\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.839718 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.839699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8f516c59-3618-4e8e-9c4b-bd8418a783a4-tls-cert\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.844697 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.844671 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tsgw\" (UniqueName: \"kubernetes.io/projected/8f516c59-3618-4e8e-9c4b-bd8418a783a4-kube-api-access-9tsgw\") pod \"authorino-769d9f4677-wwfvx\" (UID: \"8f516c59-3618-4e8e-9c4b-bd8418a783a4\") " pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:17.897241 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:17.897211 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769d9f4677-wwfvx" Jun 07 16:18:18.032685 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.032648 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769d9f4677-wwfvx"] Jun 07 16:18:18.035707 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:18:18.035677 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f516c59_3618_4e8e_9c4b_bd8418a783a4.slice/crio-b0219598318b4204bb319ebd38198b197534f5eccf176af31c8289f9862d7e8e WatchSource:0}: Error finding container b0219598318b4204bb319ebd38198b197534f5eccf176af31c8289f9862d7e8e: Status 404 returned error can't find the container with id b0219598318b4204bb319ebd38198b197534f5eccf176af31c8289f9862d7e8e Jun 07 16:18:18.146099 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.145992 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:18:18.243011 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.242980 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:18:18.832897 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.832787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769d9f4677-wwfvx" event={"ID":"8f516c59-3618-4e8e-9c4b-bd8418a783a4","Type":"ContainerStarted","Data":"cdb130068f39acb38b1e028692872c43cba7d76fdaddd76ef8345d2b90de70c4"} Jun 07 16:18:18.832897 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.832873 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769d9f4677-wwfvx" event={"ID":"8f516c59-3618-4e8e-9c4b-bd8418a783a4","Type":"ContainerStarted","Data":"b0219598318b4204bb319ebd38198b197534f5eccf176af31c8289f9862d7e8e"} Jun 07 16:18:18.854255 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.853436 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-769d9f4677-wwfvx" podStartSLOduration=1.421682992 podStartE2EDuration="1.853411761s" totalImagesPullingTime="431.728769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:18:18.851360087 +0000 UTC m=+991.437198503" watchObservedRunningTime="2026-06-07 16:18:18.853411761 +0000 UTC m=+991.439250177" Jun 07 16:18:18.884524 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.884482 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8656775d84-tkqdv"] Jun 07 16:18:18.884763 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:18.884733 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8656775d84-tkqdv" podUID="bf8b7f7d-8ff0-480c-8c9c-21a11658b741" containerName="authorino" containerID="cri-o://27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa" gracePeriod=30 Jun 07 16:18:19.135145 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.135114 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:18:19.149125 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.149087 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-tls-cert\") pod \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " Jun 07 16:18:19.149887 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.149182 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twwvf\" (UniqueName: \"kubernetes.io/projected/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-kube-api-access-twwvf\") pod \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " Jun 07 16:18:19.149887 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.149577 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-oidc-ca\") pod \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\" (UID: \"bf8b7f7d-8ff0-480c-8c9c-21a11658b741\") " Jun 07 16:18:19.152697 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.152650 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-kube-api-access-twwvf" (OuterVolumeSpecName: "kube-api-access-twwvf") pod "bf8b7f7d-8ff0-480c-8c9c-21a11658b741" (UID: "bf8b7f7d-8ff0-480c-8c9c-21a11658b741"). InnerVolumeSpecName "kube-api-access-twwvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:18:19.155340 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.155303 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "bf8b7f7d-8ff0-480c-8c9c-21a11658b741" (UID: "bf8b7f7d-8ff0-480c-8c9c-21a11658b741"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:18:19.160765 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.160740 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf8b7f7d-8ff0-480c-8c9c-21a11658b741" (UID: "bf8b7f7d-8ff0-480c-8c9c-21a11658b741"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:18:19.236537 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.236495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:18:19.250802 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.250772 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twwvf\" (UniqueName: \"kubernetes.io/projected/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-kube-api-access-twwvf\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:18:19.250802 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.250798 2572 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-oidc-ca\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:18:19.250802 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.250809 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf8b7f7d-8ff0-480c-8c9c-21a11658b741-tls-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:18:19.335511 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.335477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:18:19.837544 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.837508 2572 generic.go:356] "Generic (PLEG): container finished" podID="bf8b7f7d-8ff0-480c-8c9c-21a11658b741" containerID="27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa" exitCode=0 Jun 07 16:18:19.837544 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.837544 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8656775d84-tkqdv" Jun 07 16:18:19.838049 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.837593 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8656775d84-tkqdv" event={"ID":"bf8b7f7d-8ff0-480c-8c9c-21a11658b741","Type":"ContainerDied","Data":"27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa"} Jun 07 16:18:19.838049 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.837630 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8656775d84-tkqdv" event={"ID":"bf8b7f7d-8ff0-480c-8c9c-21a11658b741","Type":"ContainerDied","Data":"bb2107407d7729465c62b345aae23f57d9ef6e7d198c9440ed0eeaf854a2b0f2"} Jun 07 16:18:19.838049 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.837652 2572 scope.go:117] "RemoveContainer" containerID="27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa" Jun 07 16:18:19.853214 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.853194 2572 scope.go:117] "RemoveContainer" containerID="27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa" Jun 07 16:18:19.853492 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:18:19.853451 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa\": container with ID starting with 27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa not found: ID does not exist" containerID="27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa" Jun 07 16:18:19.853492 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.853477 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa"} err="failed to get container status \"27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa\": rpc error: code = NotFound desc = could not find container \"27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa\": container with ID starting with 27f6e7784177d2486e8fca58d32838c1aff43f2de676c3ddf6553417706d16aa not found: ID does not exist" Jun 07 16:18:19.868659 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.868632 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8656775d84-tkqdv"] Jun 07 16:18:19.873156 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.873136 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8656775d84-tkqdv"] Jun 07 16:18:19.886025 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:19.885999 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf8b7f7d-8ff0-480c-8c9c-21a11658b741" path="/var/lib/kubelet/pods/bf8b7f7d-8ff0-480c-8c9c-21a11658b741/volumes" Jun 07 16:18:37.551835 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:37.551801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:18:37.649285 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:18:37.649252 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:19:47.662623 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:47.662540 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:19:47.745684 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:47.745650 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-qzlc9"] Jun 07 16:19:47.745904 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:47.745856 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" podUID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" containerName="manager" containerID="cri-o://44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1" gracePeriod=30 Jun 07 16:19:47.876982 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:47.876945 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" podUID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.24:8081/readyz\": dial tcp 10.132.0.24:8081: connect: connection refused" Jun 07 16:19:47.996250 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:47.996222 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:19:48.083428 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.083385 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8clnz\" (UniqueName: \"kubernetes.io/projected/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-kube-api-access-8clnz\") pod \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " Jun 07 16:19:48.083640 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.083444 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-webhook-cert\") pod \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\" (UID: \"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9\") " Jun 07 16:19:48.085709 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.085679 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" (UID: "4b3d8e43-6011-44d9-8b6c-2fd060e38bd9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:19:48.085846 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.085717 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-kube-api-access-8clnz" (OuterVolumeSpecName: "kube-api-access-8clnz") pod "4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" (UID: "4b3d8e43-6011-44d9-8b6c-2fd060e38bd9"). InnerVolumeSpecName "kube-api-access-8clnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:19:48.184892 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.184754 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8clnz\" (UniqueName: \"kubernetes.io/projected/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-kube-api-access-8clnz\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:19:48.184892 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.184789 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9-webhook-cert\") on node \"ip-10-0-142-162.ec2.internal\" DevicePath \"\"" Jun 07 16:19:48.220121 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.220083 2572 generic.go:356] "Generic (PLEG): container finished" podID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" containerID="44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1" exitCode=0 Jun 07 16:19:48.220315 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.220142 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" event={"ID":"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9","Type":"ContainerDied","Data":"44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1"} Jun 07 16:19:48.220315 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.220147 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" Jun 07 16:19:48.220315 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.220213 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66c69d6dc7-qzlc9" event={"ID":"4b3d8e43-6011-44d9-8b6c-2fd060e38bd9","Type":"ContainerDied","Data":"39de8cdbaa0a77924ab4417579e379a3b5c4a5d531dd101bc13cd07d564d9b22"} Jun 07 16:19:48.220315 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.220234 2572 scope.go:117] "RemoveContainer" containerID="44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1" Jun 07 16:19:48.229020 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.229003 2572 scope.go:117] "RemoveContainer" containerID="44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1" Jun 07 16:19:48.229300 ip-10-0-142-162 kubenswrapper[2572]: E0607 16:19:48.229282 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1\": container with ID starting with 44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1 not found: ID does not exist" containerID="44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1" Jun 07 16:19:48.229347 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.229310 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1"} err="failed to get container status \"44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1\": rpc error: code = NotFound desc = could not find container \"44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1\": container with ID starting with 44ec6c9cd0226363c03bf60e0eb0f76f4c9cef50d77ec79f054bdc6f059ac3c1 not found: ID does not exist" Jun 07 16:19:48.240386 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.240360 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-qzlc9"] Jun 07 16:19:48.243869 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.243848 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-qzlc9"] Jun 07 16:19:48.845070 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.845036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:19:48.958213 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958178 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-bxsm9"] Jun 07 16:19:48.958466 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958454 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf8b7f7d-8ff0-480c-8c9c-21a11658b741" containerName="authorino" Jun 07 16:19:48.958509 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958467 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf8b7f7d-8ff0-480c-8c9c-21a11658b741" containerName="authorino" Jun 07 16:19:48.958509 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958481 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" containerName="manager" Jun 07 16:19:48.958509 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958487 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" containerName="manager" Jun 07 16:19:48.958600 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958544 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" containerName="manager" Jun 07 16:19:48.958600 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.958553 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf8b7f7d-8ff0-480c-8c9c-21a11658b741" containerName="authorino" Jun 07 16:19:48.962475 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.962458 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:48.964796 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.964767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6rmzg\"" Jun 07 16:19:48.965068 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.965052 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 16:19:48.965975 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.965953 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 16:19:48.970241 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.970212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-bxsm9"] Jun 07 16:19:48.991740 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.991703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmn46\" (UniqueName: \"kubernetes.io/projected/8333f849-4d8a-4512-90f0-6f3f5403dfaa-kube-api-access-dmn46\") pod \"maas-controller-66c69d6dc7-bxsm9\" (UID: \"8333f849-4d8a-4512-90f0-6f3f5403dfaa\") " pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:48.991907 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:48.991756 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8333f849-4d8a-4512-90f0-6f3f5403dfaa-webhook-cert\") pod \"maas-controller-66c69d6dc7-bxsm9\" (UID: \"8333f849-4d8a-4512-90f0-6f3f5403dfaa\") " pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:49.092681 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.092644 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmn46\" (UniqueName: \"kubernetes.io/projected/8333f849-4d8a-4512-90f0-6f3f5403dfaa-kube-api-access-dmn46\") pod \"maas-controller-66c69d6dc7-bxsm9\" (UID: \"8333f849-4d8a-4512-90f0-6f3f5403dfaa\") " pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:49.092915 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.092700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8333f849-4d8a-4512-90f0-6f3f5403dfaa-webhook-cert\") pod \"maas-controller-66c69d6dc7-bxsm9\" (UID: \"8333f849-4d8a-4512-90f0-6f3f5403dfaa\") " pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:49.095189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.095119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8333f849-4d8a-4512-90f0-6f3f5403dfaa-webhook-cert\") pod \"maas-controller-66c69d6dc7-bxsm9\" (UID: \"8333f849-4d8a-4512-90f0-6f3f5403dfaa\") " pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:49.100632 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.100599 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmn46\" (UniqueName: \"kubernetes.io/projected/8333f849-4d8a-4512-90f0-6f3f5403dfaa-kube-api-access-dmn46\") pod \"maas-controller-66c69d6dc7-bxsm9\" (UID: \"8333f849-4d8a-4512-90f0-6f3f5403dfaa\") " pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:49.273388 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.273351 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:49.405886 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.405747 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66c69d6dc7-bxsm9"] Jun 07 16:19:49.408611 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:19:49.408576 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8333f849_4d8a_4512_90f0_6f3f5403dfaa.slice/crio-ebbf86e98df639664a3e8b946cc4a947d31b9218d0fd3b50f24e791458a5e98d WatchSource:0}: Error finding container ebbf86e98df639664a3e8b946cc4a947d31b9218d0fd3b50f24e791458a5e98d: Status 404 returned error can't find the container with id ebbf86e98df639664a3e8b946cc4a947d31b9218d0fd3b50f24e791458a5e98d Jun 07 16:19:49.885996 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:49.885959 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3d8e43-6011-44d9-8b6c-2fd060e38bd9" path="/var/lib/kubelet/pods/4b3d8e43-6011-44d9-8b6c-2fd060e38bd9/volumes" Jun 07 16:19:50.230158 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:50.230125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" event={"ID":"8333f849-4d8a-4512-90f0-6f3f5403dfaa","Type":"ContainerStarted","Data":"2143118b79454fe717d3e14eb709d47f9a352faeede0e09bf03869d205c7d7ff"} Jun 07 16:19:50.230336 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:50.230180 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" event={"ID":"8333f849-4d8a-4512-90f0-6f3f5403dfaa","Type":"ContainerStarted","Data":"ebbf86e98df639664a3e8b946cc4a947d31b9218d0fd3b50f24e791458a5e98d"} Jun 07 16:19:50.230336 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:50.230249 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:19:50.246482 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:19:50.246424 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" podStartSLOduration=1.872821799 podStartE2EDuration="2.246406934s" totalImagesPullingTime="373.585135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:19:50.245129338 +0000 UTC m=+1082.830967753" watchObservedRunningTime="2026-06-07 16:19:50.246406934 +0000 UTC m=+1082.832245400" Jun 07 16:20:01.242398 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:01.242367 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66c69d6dc7-bxsm9" Jun 07 16:20:08.633072 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:08.633023 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:28.629343 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:28.629307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:28.728977 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:28.728946 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:28.955185 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:28.955155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:29.497461 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:29.497426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:29.597141 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:29.597108 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:37.107526 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:37.107479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:42.854282 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:42.854248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:20:42.954925 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:20:42.954890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:14.959311 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:14.959209 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:15.061647 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:15.061582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:15.158459 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:15.158427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:15.619511 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:15.619482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:15.721447 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:15.721408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:38.926366 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:38.926337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:44.639390 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:44.639357 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:44.743333 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:44.743298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:44.839472 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:44.839436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:44.984714 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:44.984665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:45.084933 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:45.084893 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:47.542189 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:47.542153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:21:47.895480 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:47.895396 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:21:47.896999 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:21:47.896975 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:22:01.471249 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:01.471210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:01.570290 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:01.570256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:01.672202 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:01.672173 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:07.416416 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:07.416372 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:07.516117 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:07.516059 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:15.565165 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:15.565134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:15.664264 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:15.664230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:15.765140 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:15.765103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:15.864056 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:15.863926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:32.225028 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:32.224977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:32.346950 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:32.346910 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:32.453767 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:32.453729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:38.174806 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:38.174718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:38.294706 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:38.294674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:22:46.776841 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:46.776785 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769d9f4677-wwfvx_8f516c59-3618-4e8e-9c4b-bd8418a783a4/authorino/0.log" Jun 07 16:22:51.597512 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:51.597477 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66c69d6dc7-bxsm9_8333f849-4d8a-4512-90f0-6f3f5403dfaa/manager/0.log" Jun 07 16:22:52.043056 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:52.043024 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-skgzq_0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f/copy-manifests/0.log" Jun 07 16:22:52.055145 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:52.055118 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-skgzq_0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f/manager/0.log" Jun 07 16:22:53.383994 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:53.383965 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769d9f4677-wwfvx_8f516c59-3618-4e8e-9c4b-bd8418a783a4/authorino/0.log" Jun 07 16:22:53.706027 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:53.706001 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9xmpz_e9f03177-341e-4137-9ee9-47310c762b16/kuadrant-console-plugin/0.log" Jun 07 16:22:54.839989 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:54.839959 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-rtgln_68ac4379-4e05-4989-817c-afd34ef09e12/kube-auth-proxy/0.log" Jun 07 16:22:55.058419 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:55.058389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-d7jt7_8a922ce3-79ad-44df-82b8-911408e2f001/payload-pre-processing/0.log" Jun 07 16:22:55.167350 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:55.167272 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fkmqx_ad4bc12d-8f61-44e1-b2be-d7aea82885f8/payload-processing/0.log" Jun 07 16:22:55.707956 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:55.707906 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7nrsq_d1fe890b-b71e-419c-8f12-edebed03267c/main/0.log" Jun 07 16:22:55.714756 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:22:55.714734 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7nrsq_d1fe890b-b71e-419c-8f12-edebed03267c/storage-initializer/0.log" Jun 07 16:23:00.403719 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.403669 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59tjk/must-gather-kcw5n"] Jun 07 16:23:00.405978 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.405958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.408492 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.408470 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59tjk\"/\"openshift-service-ca.crt\"" Jun 07 16:23:00.408595 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.408519 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-59tjk\"/\"default-dockercfg-mcg5b\"" Jun 07 16:23:00.408595 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.408544 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59tjk\"/\"kube-root-ca.crt\"" Jun 07 16:23:00.417805 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.417783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:23:00.422557 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.422536 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/must-gather-kcw5n"] Jun 07 16:23:00.520432 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.520396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" limit=1024 Jun 07 16:23:00.552575 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.552539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ec627f2-c690-4b06-ab9a-c59128c3bb2f-must-gather-output\") pod \"must-gather-kcw5n\" (UID: \"7ec627f2-c690-4b06-ab9a-c59128c3bb2f\") " pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.552721 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.552588 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgqsn\" (UniqueName: \"kubernetes.io/projected/7ec627f2-c690-4b06-ab9a-c59128c3bb2f-kube-api-access-zgqsn\") pod \"must-gather-kcw5n\" (UID: \"7ec627f2-c690-4b06-ab9a-c59128c3bb2f\") " pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.654087 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.653986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ec627f2-c690-4b06-ab9a-c59128c3bb2f-must-gather-output\") pod \"must-gather-kcw5n\" (UID: \"7ec627f2-c690-4b06-ab9a-c59128c3bb2f\") " pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.654087 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.654042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgqsn\" (UniqueName: \"kubernetes.io/projected/7ec627f2-c690-4b06-ab9a-c59128c3bb2f-kube-api-access-zgqsn\") pod \"must-gather-kcw5n\" (UID: \"7ec627f2-c690-4b06-ab9a-c59128c3bb2f\") " pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.654376 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.654355 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ec627f2-c690-4b06-ab9a-c59128c3bb2f-must-gather-output\") pod \"must-gather-kcw5n\" (UID: \"7ec627f2-c690-4b06-ab9a-c59128c3bb2f\") " pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.662482 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.662460 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgqsn\" (UniqueName: \"kubernetes.io/projected/7ec627f2-c690-4b06-ab9a-c59128c3bb2f-kube-api-access-zgqsn\") pod \"must-gather-kcw5n\" (UID: \"7ec627f2-c690-4b06-ab9a-c59128c3bb2f\") " pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.715394 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.715348 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/must-gather-kcw5n" Jun 07 16:23:00.849660 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.849625 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/must-gather-kcw5n"] Jun 07 16:23:00.852277 ip-10-0-142-162 kubenswrapper[2572]: W0607 16:23:00.852248 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ec627f2_c690_4b06_ab9a_c59128c3bb2f.slice/crio-f591ebeb2a01ed948265490807a7720ee8e8b4356069185b20303040a8585580 WatchSource:0}: Error finding container f591ebeb2a01ed948265490807a7720ee8e8b4356069185b20303040a8585580: Status 404 returned error can't find the container with id f591ebeb2a01ed948265490807a7720ee8e8b4356069185b20303040a8585580 Jun 07 16:23:00.853992 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:00.853974 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:23:01.053765 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:01.053728 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/must-gather-kcw5n" event={"ID":"7ec627f2-c690-4b06-ab9a-c59128c3bb2f","Type":"ContainerStarted","Data":"f591ebeb2a01ed948265490807a7720ee8e8b4356069185b20303040a8585580"} Jun 07 16:23:02.061781 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:02.061743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/must-gather-kcw5n" event={"ID":"7ec627f2-c690-4b06-ab9a-c59128c3bb2f","Type":"ContainerStarted","Data":"bdd37c19c60cec1d30e749ad13be91e6e229429c51f8b928a04c087e674da8c4"} Jun 07 16:23:02.062293 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:02.061794 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/must-gather-kcw5n" event={"ID":"7ec627f2-c690-4b06-ab9a-c59128c3bb2f","Type":"ContainerStarted","Data":"bba54232eacaf609850fc7d9c6df1f6ca1829b7862f8f40c61537b9c905f81bb"} Jun 07 16:23:02.077947 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:02.077878 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59tjk/must-gather-kcw5n" podStartSLOduration=1.143629358 podStartE2EDuration="2.077855583s" totalImagesPullingTime="934.226225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:23:02.075891838 +0000 UTC m=+1274.661730254" watchObservedRunningTime="2026-06-07 16:23:02.077855583 +0000 UTC m=+1274.663694000" Jun 07 16:23:03.467875 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:03.467804 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qcd4m_209644e1-7cd5-44e7-8894-278589a38a88/global-pull-secret-syncer/0.log" Jun 07 16:23:03.522012 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:03.521974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4csj6_13b02d20-dec0-4531-b44f-dc3d0fb43149/konnectivity-agent/0.log" Jun 07 16:23:03.614432 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:03.614403 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-162.ec2.internal_92b0d35ab8ab1eceed4098a9c3cb9653/haproxy/0.log" Jun 07 16:23:08.408468 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:08.408435 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769d9f4677-wwfvx_8f516c59-3618-4e8e-9c4b-bd8418a783a4/authorino/0.log" Jun 07 16:23:08.540756 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:08.540728 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9xmpz_e9f03177-341e-4137-9ee9-47310c762b16/kuadrant-console-plugin/0.log" Jun 07 16:23:10.749674 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:10.749578 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rsgd8_ec8c898d-cc8c-444d-83d6-9920e46e13f5/node-exporter/0.log" Jun 07 16:23:10.769207 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:10.769160 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rsgd8_ec8c898d-cc8c-444d-83d6-9920e46e13f5/kube-rbac-proxy/0.log" Jun 07 16:23:10.796069 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:10.796041 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rsgd8_ec8c898d-cc8c-444d-83d6-9920e46e13f5/init-textfile/0.log" Jun 07 16:23:14.891258 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.891223 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz"] Jun 07 16:23:14.898573 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.898540 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:14.907692 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.907656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz"] Jun 07 16:23:14.981054 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.981017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-sys\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:14.981252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.981087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-lib-modules\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:14.981252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.981140 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-proc\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:14.981252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.981172 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m2bv\" (UniqueName: \"kubernetes.io/projected/8a6da69d-a34c-4ca5-810c-18424f76ae59-kube-api-access-6m2bv\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:14.981252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:14.981202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-podres\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.081894 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.081855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-sys\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082083 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.081907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-lib-modules\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082083 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.081943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-proc\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082083 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.081965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m2bv\" (UniqueName: \"kubernetes.io/projected/8a6da69d-a34c-4ca5-810c-18424f76ae59-kube-api-access-6m2bv\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082083 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.081986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-podres\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082083 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.081991 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-sys\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082083 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.082075 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-proc\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082420 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.082116 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-lib-modules\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.082420 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.082145 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a6da69d-a34c-4ca5-810c-18424f76ae59-podres\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.091877 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.091815 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m2bv\" (UniqueName: \"kubernetes.io/projected/8a6da69d-a34c-4ca5-810c-18424f76ae59-kube-api-access-6m2bv\") pod \"perf-node-gather-daemonset-c9xxz\" (UID: \"8a6da69d-a34c-4ca5-810c-18424f76ae59\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.217153 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.217100 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:15.411664 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:15.411636 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz"] Jun 07 16:23:16.006671 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.006635 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4q4wd_75c27db2-6786-471c-8492-171dc3c290a9/dns/0.log" Jun 07 16:23:16.029522 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.029490 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4q4wd_75c27db2-6786-471c-8492-171dc3c290a9/kube-rbac-proxy/0.log" Jun 07 16:23:16.141008 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.140969 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5v7b2_2863b1a0-37a5-4fe7-9b2f-ee6e6e06f06e/dns-node-resolver/0.log" Jun 07 16:23:16.156439 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.156403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" event={"ID":"8a6da69d-a34c-4ca5-810c-18424f76ae59","Type":"ContainerStarted","Data":"4506cace926888d32bfcc8a0bbce2126ca7b293c0f59d5f8b6d5cf6ffd923d93"} Jun 07 16:23:16.156670 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.156482 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" event={"ID":"8a6da69d-a34c-4ca5-810c-18424f76ae59","Type":"ContainerStarted","Data":"5924479cb3df80a678a8c8efa26e44069d165f08f21a39b1192816aa1ce85858"} Jun 07 16:23:16.157272 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.157241 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:16.700251 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:16.700219 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mslzn_b368c86d-aaf4-41a1-9a79-a6bbe2a88807/node-ca/0.log" Jun 07 16:23:17.730207 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:17.730179 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-rtgln_68ac4379-4e05-4989-817c-afd34ef09e12/kube-auth-proxy/0.log" Jun 07 16:23:17.793666 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:17.793639 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-d7jt7_8a922ce3-79ad-44df-82b8-911408e2f001/payload-pre-processing/0.log" Jun 07 16:23:17.834252 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:17.834208 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fkmqx_ad4bc12d-8f61-44e1-b2be-d7aea82885f8/payload-processing/0.log" Jun 07 16:23:18.489897 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:18.489864 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wfqct_a1a0c468-b501-4db6-8d08-b0542d58a057/serve-healthcheck-canary/0.log" Jun 07 16:23:19.063014 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:19.062984 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbqx6_71979a85-1d2b-4da5-97d3-cde2c7c9abb9/kube-rbac-proxy/0.log" Jun 07 16:23:19.087244 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:19.087214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbqx6_71979a85-1d2b-4da5-97d3-cde2c7c9abb9/exporter/0.log" Jun 07 16:23:19.106485 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:19.106456 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbqx6_71979a85-1d2b-4da5-97d3-cde2c7c9abb9/extractor/0.log" Jun 07 16:23:21.425101 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:21.425069 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66c69d6dc7-bxsm9_8333f849-4d8a-4512-90f0-6f3f5403dfaa/manager/0.log" Jun 07 16:23:21.597789 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:21.597751 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-skgzq_0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f/manager/0.log" Jun 07 16:23:21.618895 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:21.618868 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-skgzq_0fa8daf0-1729-4b0e-9d0c-20e2c84e9f7f/copy-manifests/0.log" Jun 07 16:23:23.099985 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:23.099960 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-594b75d8b-gjtd4_995e1912-fc59-41ac-84d1-df1a09f016c5/manager/0.log" Jun 07 16:23:23.122469 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:23.122435 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fw2pg_fae226b1-41b1-4bbc-b812-f0bd1a23dc54/openshift-lws-operator/0.log" Jun 07 16:23:23.180848 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:23.180792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" Jun 07 16:23:23.199434 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:23.197335 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-c9xxz" podStartSLOduration=9.19731449 podStartE2EDuration="9.19731449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:23:16.172375974 +0000 UTC m=+1288.758214390" watchObservedRunningTime="2026-06-07 16:23:23.19731449 +0000 UTC m=+1295.783152906" Jun 07 16:23:29.142312 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:29.142278 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-rtgln_68ac4379-4e05-4989-817c-afd34ef09e12/kube-auth-proxy/0.log" Jun 07 16:23:29.195289 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:29.195251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-d7jt7_8a922ce3-79ad-44df-82b8-911408e2f001/payload-pre-processing/0.log" Jun 07 16:23:29.229815 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:29.229738 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fkmqx_ad4bc12d-8f61-44e1-b2be-d7aea82885f8/payload-processing/0.log" Jun 07 16:23:30.384039 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.384009 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/kube-multus-additional-cni-plugins/0.log" Jun 07 16:23:30.406300 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.406272 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/egress-router-binary-copy/0.log" Jun 07 16:23:30.408384 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.408346 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-rtgln_68ac4379-4e05-4989-817c-afd34ef09e12/kube-auth-proxy/0.log" Jun 07 16:23:30.426430 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.426382 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/cni-plugins/0.log" Jun 07 16:23:30.452434 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.452409 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/bond-cni-plugin/0.log" Jun 07 16:23:30.456422 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.456398 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-d7jt7_8a922ce3-79ad-44df-82b8-911408e2f001/payload-pre-processing/0.log" Jun 07 16:23:30.476996 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.476937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/routeoverride-cni/0.log" Jun 07 16:23:30.487063 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.487036 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fkmqx_ad4bc12d-8f61-44e1-b2be-d7aea82885f8/payload-processing/0.log" Jun 07 16:23:30.499184 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.499152 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/whereabouts-cni-bincopy/0.log" Jun 07 16:23:30.521330 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.521295 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f4jk9_2da31f98-f1cd-42e9-aa3c-7eaa6374a9a7/whereabouts-cni/0.log" Jun 07 16:23:30.868927 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:30.868852 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m9zmw_4f6ba2a5-aa60-4c73-b8ea-1c527c841030/kube-multus/0.log" Jun 07 16:23:31.014188 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:31.014158 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sdppg_604c1b4f-4cce-439d-9d2c-b28fb53f84c8/network-metrics-daemon/0.log" Jun 07 16:23:31.032640 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:31.032610 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sdppg_604c1b4f-4cce-439d-9d2c-b28fb53f84c8/kube-rbac-proxy/0.log" Jun 07 16:23:32.181090 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.181064 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-746d4cf656-rtgln_68ac4379-4e05-4989-817c-afd34ef09e12/kube-auth-proxy/0.log" Jun 07 16:23:32.226120 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.226088 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-d7jt7_8a922ce3-79ad-44df-82b8-911408e2f001/payload-pre-processing/0.log" Jun 07 16:23:32.253288 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.253263 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fkmqx_ad4bc12d-8f61-44e1-b2be-d7aea82885f8/payload-processing/0.log" Jun 07 16:23:32.370432 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.370397 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-controller/0.log" Jun 07 16:23:32.387725 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.387691 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/1.log" Jun 07 16:23:32.387927 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.387855 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovn-acl-logging/0.log" Jun 07 16:23:32.408251 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.408223 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/kube-rbac-proxy-node/0.log" Jun 07 16:23:32.427233 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.427202 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/kube-rbac-proxy-ovn-metrics/0.log" Jun 07 16:23:32.443260 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.443201 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/northd/0.log" Jun 07 16:23:32.462732 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.462709 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/nbdb/0.log" Jun 07 16:23:32.484437 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.484408 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/sbdb/0.log" Jun 07 16:23:32.533882 ip-10-0-142-162 kubenswrapper[2572]: I0607 16:23:32.533855 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w5z2h_a51625bd-4b6f-4bf4-8a98-0529a7f0298c/ovnkube-controller/0.log"