Jun 05 13:21:56.774163 ip-10-0-138-68 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 13:21:56.774173 ip-10-0-138-68 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 13:21:56.774182 ip-10-0-138-68 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 13:21:56.774401 ip-10-0-138-68 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 13:22:06.908631 ip-10-0-138-68 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 13:22:06.908650 ip-10-0-138-68 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 925b839f504846548a65a65582f0256e -- Jun 05 13:24:51.054643 ip-10-0-138-68 systemd[1]: Starting Kubernetes Kubelet... Jun 05 13:24:51.465521 ip-10-0-138-68 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:24:51.465521 ip-10-0-138-68 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 13:24:51.465521 ip-10-0-138-68 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:24:51.465521 ip-10-0-138-68 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 13:24:51.465521 ip-10-0-138-68 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:24:51.467793 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.467704 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 13:24:51.472028 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472011 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:51.472028 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472027 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:51.472028 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472031 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472034 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472037 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472040 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472044 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472047 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472050 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472053 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472055 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472058 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472060 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472063 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472065 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472071 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472074 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472078 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472080 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472083 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472087 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:51.472120 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472089 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472092 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472094 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472097 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472100 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472102 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472105 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472107 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472110 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472113 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472115 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472118 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472120 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472123 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472126 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472129 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472132 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472135 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472139 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472141 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:51.472610 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472144 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472147 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472149 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472153 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472155 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472158 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472160 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472163 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472165 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472169 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472171 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472174 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472176 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472179 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472182 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472186 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472188 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472192 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472194 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472197 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:51.473182 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472201 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472205 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472208 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472211 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472228 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472234 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472238 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472293 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472299 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472302 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472305 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472309 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472312 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472315 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472318 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472321 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472324 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472327 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472330 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:51.473684 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472332 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472335 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472338 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472340 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472343 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472345 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472348 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472353 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472356 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472359 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472361 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472364 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472367 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472369 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472372 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472374 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472377 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472379 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.472382 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473156 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:51.474147 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473164 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473168 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473171 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473175 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473178 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473182 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473185 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473188 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473191 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473194 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473197 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473200 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473202 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473205 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473208 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473210 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473228 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473231 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473234 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473238 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:51.474662 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473241 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473243 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473246 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473249 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473252 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473254 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473257 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473260 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473262 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473265 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473267 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473270 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473273 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473276 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473279 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473283 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473286 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473289 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473292 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473295 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:51.475170 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473297 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473300 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473303 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473306 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473308 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473311 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473314 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473316 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473319 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473322 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473325 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473329 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473332 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473335 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473337 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473340 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473342 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473345 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473347 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473350 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:51.475685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473352 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473355 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473357 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473360 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473362 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473364 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473367 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473370 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473373 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473375 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473378 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473381 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473383 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473386 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473389 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473391 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473394 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473397 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473399 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:51.476201 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473402 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473404 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473408 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473410 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473413 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473416 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473418 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473421 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473424 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473426 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473429 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473431 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473434 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473437 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473439 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473442 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473446 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473449 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473452 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:51.476702 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473834 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473839 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473842 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473845 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473847 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473851 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473853 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473856 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473858 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473861 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473863 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473866 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473868 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473871 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473873 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473876 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473880 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473883 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473886 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:51.477180 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473888 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473891 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473894 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473896 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473899 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473901 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473904 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473907 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473909 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473912 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473914 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473917 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473919 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473922 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473925 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473928 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473931 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473933 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473936 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473939 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:51.477680 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473942 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473945 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473948 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473950 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473953 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473955 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473958 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473960 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473963 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473966 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473968 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473971 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473973 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473976 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473978 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473981 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473983 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473985 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473988 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:51.478162 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473990 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473995 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.473998 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474001 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474004 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474007 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474010 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474013 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474020 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474024 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474027 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474030 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474033 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474036 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474039 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474042 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474044 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474047 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474050 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474053 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:51.478681 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474056 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474058 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474061 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474064 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474067 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474069 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474072 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474074 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474077 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474079 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474082 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474084 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474087 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474089 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474092 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474094 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474097 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474099 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474102 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474104 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:51.479206 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474110 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474201 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474225 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474236 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474240 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474244 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474248 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474253 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474258 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474261 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474264 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474268 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474271 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474274 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474278 2579 flags.go:64] FLAG: --cgroup-root="" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474281 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474284 2579 flags.go:64] FLAG: --client-ca-file="" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474287 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474290 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474294 2579 flags.go:64] FLAG: --cluster-domain="" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474297 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474300 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474303 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474307 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 13:24:51.479744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474310 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474314 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474317 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474320 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474323 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474326 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474331 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474335 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474338 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474343 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474346 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474349 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474351 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474354 2579 flags.go:64] FLAG: --enable-server="true" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474358 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474363 2579 flags.go:64] FLAG: --event-burst="100" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474366 2579 flags.go:64] FLAG: --event-qps="50" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474370 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474373 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474376 2579 flags.go:64] FLAG: --eviction-hard="" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474379 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474382 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474385 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474388 2579 flags.go:64] FLAG: --eviction-soft="" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474391 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 13:24:51.480409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474394 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474397 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474400 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474403 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474406 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474409 2579 flags.go:64] FLAG: --feature-gates="" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474413 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474416 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474419 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474422 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474425 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474428 2579 flags.go:64] FLAG: --help="false" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474431 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474435 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474438 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474441 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474445 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474448 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474451 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474454 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474457 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474460 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474463 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474466 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 13:24:51.481058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474470 2579 flags.go:64] FLAG: --kube-reserved="" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474473 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474476 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474479 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474482 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474484 2579 flags.go:64] FLAG: --lock-file="" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474487 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474490 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474493 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474498 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474501 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474504 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474507 2579 flags.go:64] FLAG: --logging-format="text" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474510 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474513 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474516 2579 flags.go:64] FLAG: --manifest-url="" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474519 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474524 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474527 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474531 2579 flags.go:64] FLAG: --max-pods="110" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474534 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474541 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474544 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474548 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474551 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 13:24:51.481715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474554 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474557 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474564 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474567 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474570 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474574 2579 flags.go:64] FLAG: --pod-cidr="" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474577 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474583 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474587 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474590 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474593 2579 flags.go:64] FLAG: --port="10250" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474596 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474599 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f58f2af179f72c2" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474602 2579 flags.go:64] FLAG: --qos-reserved="" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474605 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474608 2579 flags.go:64] FLAG: --register-node="true" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474611 2579 flags.go:64] FLAG: --register-with-taints="" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474614 2579 flags.go:64] FLAG: --registry-burst="10" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474617 2579 flags.go:64] FLAG: --registry-qps="5" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474620 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474623 2579 flags.go:64] FLAG: --reserved-memory="" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474627 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474630 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474633 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474636 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 13:24:51.482759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474639 2579 flags.go:64] FLAG: --runonce="false" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474642 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474646 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474650 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474653 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474656 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474659 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474662 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474665 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474668 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474671 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474675 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474678 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474681 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474684 2579 flags.go:64] FLAG: --system-cgroups="" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474687 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474693 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474695 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474698 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474702 2579 flags.go:64] FLAG: --tls-min-version="" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474704 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474707 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474710 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474713 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474715 2579 flags.go:64] FLAG: --v="2" Jun 05 13:24:51.483552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474719 2579 flags.go:64] FLAG: --version="false" Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474723 2579 flags.go:64] FLAG: --vmodule="" Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474727 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.474730 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474864 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474868 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474871 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474874 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474876 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474879 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474884 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474886 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474889 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474893 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474895 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474898 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474900 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474903 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474906 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474908 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474911 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:51.484181 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474913 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474916 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474919 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474922 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474924 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474927 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474930 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474932 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474935 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474937 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474940 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474943 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474945 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474948 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474951 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474954 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474957 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474959 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474961 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474964 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:51.484745 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474967 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474971 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474974 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474976 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474981 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474984 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474987 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474989 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474992 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474995 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.474998 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475000 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475003 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475006 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475008 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475012 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475014 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475017 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475019 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475022 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:51.485268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475024 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475027 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475029 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475032 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475035 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475038 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475040 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475043 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475045 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475048 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475051 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475053 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475056 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475059 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475062 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475065 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475070 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475074 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475077 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:51.485769 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475080 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475083 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475085 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475088 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475092 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475096 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475099 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475102 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475105 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475108 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475110 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475113 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475116 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475118 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475121 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475123 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475126 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475128 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475131 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475133 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:51.486268 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475136 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475138 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.475142 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.475686 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.483923 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.483939 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.483961 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.483967 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484028 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484035 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484040 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484043 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484046 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484049 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:51.486761 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484052 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484055 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484058 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484061 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484063 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484067 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484069 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484072 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484076 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484080 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484083 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484086 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484089 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484092 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484096 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484099 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484103 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484105 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484108 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:51.487111 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484111 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484114 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484117 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484119 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484122 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484125 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484128 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484130 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484133 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484136 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484139 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484141 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484144 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484147 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484150 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484152 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484155 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484157 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484161 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:51.487590 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484163 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484166 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484169 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484172 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484175 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484177 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484180 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484182 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484185 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484188 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484192 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484194 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484197 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484200 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484203 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484205 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484208 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484210 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484229 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484234 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:51.488091 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484238 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484241 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484244 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484246 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484249 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484252 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484255 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484257 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484260 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484263 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484265 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484269 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484284 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484288 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484291 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484295 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484297 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484301 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484303 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484306 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:51.488609 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484309 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484311 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484314 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484317 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484320 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484323 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484325 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484328 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484331 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484334 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484336 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484339 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484342 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484345 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484347 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:51.489101 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.484353 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484475 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484480 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484483 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484486 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484489 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484493 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484496 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484498 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484501 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484504 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484506 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484509 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484512 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484515 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484518 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484520 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484523 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484525 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:51.489493 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484528 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484530 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484533 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484535 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484538 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484541 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484544 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484546 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484549 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484551 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484554 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484557 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484560 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484565 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484568 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484570 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484573 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484575 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484578 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:51.489959 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484581 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484583 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484586 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484588 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484593 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484595 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484598 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484602 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484606 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484609 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484612 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484614 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484617 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484619 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484622 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484624 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484627 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484629 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484632 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484634 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:51.490430 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484637 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484639 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484642 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484644 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484647 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484650 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484652 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484655 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484658 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484661 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484663 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484665 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484668 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484670 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484673 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484675 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484681 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484684 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484687 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484690 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:51.490960 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484693 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484696 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484698 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484701 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484703 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484706 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484709 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484712 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484714 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484717 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484719 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484722 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484724 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484727 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484729 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484732 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484734 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484737 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484739 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484742 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:51.491464 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484744 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:51.484747 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.484752 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.484872 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.487525 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.488906 2579 server.go:1019] "Starting client certificate rotation" Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.489011 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.489047 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:24:51.491954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.491547 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:24:51.492830 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.492814 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:24:51.500006 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.499989 2579 log.go:25] "Validated CRI v1 runtime API" Jun 05 13:24:51.502856 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.502837 2579 log.go:25] "Validated CRI v1 image API" Jun 05 13:24:51.503794 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.503777 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 13:24:51.508992 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.508973 2579 fs.go:135] Filesystem UUIDs: map[353b7072-e7f5-4ffd-b609-1fc550cfa41c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f90b4ea9-f4cf-4969-9e2c-554c77406cde:/dev/nvme0n1p3] Jun 05 13:24:51.509048 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.508992 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 13:24:51.514985 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.514861 2579 manager.go:216] Machine: {Timestamp:2026-06-05 13:24:51.513656636 +0000 UTC m=+0.328606282 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3145182 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce13ed245cca0b9f8d7357f78613c SystemUUID:ec2ce13e-d245-cca0-b9f8-d7357f78613c BootID:925b839f-5048-4654-8a65-a65582f0256e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:ec:c6:17:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:ec:c6:17:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:a1:39:f7:81:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 13:24:51.515075 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.514991 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 13:24:51.515148 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.515135 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 13:24:51.517046 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.517030 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:24:51.518138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.518109 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 13:24:51.518291 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.518142 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 13:24:51.519470 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.519459 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 13:24:51.519509 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.519472 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 13:24:51.519509 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.519480 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:24:51.520260 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.520243 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:24:51.521104 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.521095 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 13:24:51.523930 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.523919 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:24:51.524042 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.524033 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 13:24:51.524077 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.524060 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 05 13:24:51.524280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.524269 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 13:24:51.524324 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.524312 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 13:24:51.524366 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.524324 2579 kubelet.go:398] "Adding apiserver pod source" Jun 05 13:24:51.524366 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.524334 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 13:24:51.525553 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.525532 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:24:51.525656 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.525563 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:24:51.529460 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.529439 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 13:24:51.530922 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.530908 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 13:24:51.530966 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.530941 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 13:24:51.531542 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531531 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 13:24:51.531575 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531551 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 13:24:51.531575 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531561 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 13:24:51.531575 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531568 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 13:24:51.531657 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531577 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 13:24:51.531657 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531583 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 13:24:51.531708 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531694 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 13:24:51.531708 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531699 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 13:24:51.531708 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531705 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 13:24:51.531787 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531711 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 13:24:51.531787 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531720 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 13:24:51.531787 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.531727 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 13:24:51.532663 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.532650 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 13:24:51.532696 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.532666 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 13:24:51.535948 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.535928 2579 server.go:1268] "Started kubelet" Jun 05 13:24:51.536040 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.536000 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 13:24:51.536090 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.536022 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 13:24:51.536128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.536102 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 13:24:51.537021 ip-10-0-138-68 systemd[1]: Started Kubernetes Kubelet. Jun 05 13:24:51.537163 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.537031 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:51.537163 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.537063 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:24:51.537286 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.537240 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:24:51.537732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.537710 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 13:24:51.538412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.538399 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 05 13:24:51.541980 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.540824 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231a8a6c66c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.53589822 +0000 UTC m=+0.350847867,LastTimestamp:2026-06-05 13:24:51.53589822 +0000 UTC m=+0.350847867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.544716 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.544697 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 13:24:51.545000 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.544987 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 13:24:51.545054 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.545002 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 13:24:51.545054 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.545050 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:24:51.545583 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.545565 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 13:24:51.545583 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.545565 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 13:24:51.545698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.545592 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 13:24:51.545698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.545686 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 05 13:24:51.545698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.545697 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 05 13:24:51.546578 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546562 2579 factory.go:55] Registering systemd factory Jun 05 13:24:51.546657 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546582 2579 factory.go:223] Registration of the systemd container factory successfully Jun 05 13:24:51.546814 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546798 2579 factory.go:153] Registering CRI-O factory Jun 05 13:24:51.546859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546819 2579 factory.go:223] Registration of the crio container factory successfully Jun 05 13:24:51.546919 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546872 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 13:24:51.546919 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546895 2579 factory.go:103] Registering Raw factory Jun 05 13:24:51.546919 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.546905 2579 manager.go:1196] Started watching for new ooms in manager Jun 05 13:24:51.547362 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.547345 2579 manager.go:349] Starting recovery of all containers Jun 05 13:24:51.555953 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.555920 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 13:24:51.556070 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.556031 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:24:51.560481 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.560466 2579 manager.go:354] Recovery completed Jun 05 13:24:51.564363 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.564279 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.566443 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.566420 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.566512 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.566458 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.566512 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.566472 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.566996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.566979 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 13:24:51.566996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.566987 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.567128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.566994 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 13:24:51.567128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.567029 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:24:51.567698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.567679 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.567781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.567710 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.567781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.567721 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.568272 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.568258 2579 policy_none.go:49] "None policy: Start" Jun 05 13:24:51.568333 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.568279 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 13:24:51.568333 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.568293 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 13:24:51.569386 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.569372 2579 policy_none.go:47] "Start" Jun 05 13:24:51.576111 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.576041 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.584070 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.583998 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.593167 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.593098 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.607898 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.607826 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.567696422 +0000 UTC m=+0.382646069,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.610937 2579 manager.go:337] "Starting Device Plugin manager" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.610972 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.610985 2579 server.go:87] "Starting device plugin registration server" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.611278 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.611294 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.611389 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.611516 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.611529 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.612258 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.612359 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.612411 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.613550 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.613586 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.613606 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 13:24:51.614503 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.613688 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 13:24:51.620483 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.619011 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:24:51.620483 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.619443 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.567715722 +0000 UTC m=+0.382665370,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.627299 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.627241 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa795ab4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.567725134 +0000 UTC m=+0.382674781,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.635153 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.635093 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231ad44559e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.613332894 +0000 UTC m=+0.428282531,LastTimestamp:2026-06-05 13:24:51.613332894 +0000 UTC m=+0.428282531,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.712445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.712417 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.713739 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.713711 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.713850 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.713748 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.713850 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.713763 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.713850 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.713786 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.714479 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.713724 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal"] Jun 05 13:24:51.714541 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.714524 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.715592 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.715547 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.715592 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.715573 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.715592 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.715584 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.716835 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.716823 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.716964 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.716950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.717004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.716983 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.717593 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.717577 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.717677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.717597 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.717677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.717606 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.717746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.717686 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.717746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.717709 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.717746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.717722 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.718885 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.718869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.718992 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.718901 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.719923 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.719908 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.719998 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.719928 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.719998 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.719937 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.722812 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.722745 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.713731831 +0000 UTC m=+0.528681482,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.731886 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.731853 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.731992 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.731929 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.7137549 +0000 UTC m=+0.528704546,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.734336 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.734277 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa795ab4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.713767082 +0000 UTC m=+0.528716728,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.737833 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.737818 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.740426 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.740337 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.715561562 +0000 UTC m=+0.530511209,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.742286 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.742268 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.743086 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.743021 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.71557791 +0000 UTC m=+0.530527557,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.746631 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.746612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b68af79435ad678ea4ebc6254094909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal\" (UID: \"6b68af79435ad678ea4ebc6254094909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.746711 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.746639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b68af79435ad678ea4ebc6254094909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal\" (UID: \"6b68af79435ad678ea4ebc6254094909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.746711 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.746671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b14f857cc16244b09eb7237ec6ff376b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-68.ec2.internal\" (UID: \"b14f857cc16244b09eb7237ec6ff376b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.750298 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.750234 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa795ab4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.715587301 +0000 UTC m=+0.530536948,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.759340 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.759317 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jun 05 13:24:51.759426 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.759318 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.717590549 +0000 UTC m=+0.532540195,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.766918 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.766845 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.717601887 +0000 UTC m=+0.532551534,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.777573 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.777502 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa795ab4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.717610692 +0000 UTC m=+0.532560339,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.785147 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.785090 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.71769823 +0000 UTC m=+0.532647880,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.797753 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.797689 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.717714805 +0000 UTC m=+0.532664453,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.805863 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.805802 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa795ab4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.717727605 +0000 UTC m=+0.532677254,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.814480 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.814423 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.719919992 +0000 UTC m=+0.534869638,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.822117 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.822060 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.719932506 +0000 UTC m=+0.534882152,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.832283 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.832195 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa795ab4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa795ab4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566475956 +0000 UTC m=+0.381425603,LastTimestamp:2026-06-05 13:24:51.719940615 +0000 UTC m=+0.534890321,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.847537 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.847511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b14f857cc16244b09eb7237ec6ff376b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-68.ec2.internal\" (UID: \"b14f857cc16244b09eb7237ec6ff376b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.847608 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.847546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b68af79435ad678ea4ebc6254094909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal\" (UID: \"6b68af79435ad678ea4ebc6254094909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.847608 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.847565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b68af79435ad678ea4ebc6254094909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal\" (UID: \"6b68af79435ad678ea4ebc6254094909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.847676 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.847611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b68af79435ad678ea4ebc6254094909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal\" (UID: \"6b68af79435ad678ea4ebc6254094909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.847676 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.847617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b14f857cc16244b09eb7237ec6ff376b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-68.ec2.internal\" (UID: \"b14f857cc16244b09eb7237ec6ff376b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.847676 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.847654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b68af79435ad678ea4ebc6254094909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal\" (UID: \"6b68af79435ad678ea4ebc6254094909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.932630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.932599 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:51.933637 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.933619 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:51.933703 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.933651 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:51.933703 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.933661 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:51.933703 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:51.933689 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.942976 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.942875 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa78d79c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa78d79c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566442396 +0000 UTC m=+0.381392043,LastTimestamp:2026-06-05 13:24:51.933636546 +0000 UTC m=+0.748586192,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:51.950641 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.950616 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:51.950703 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:51.950602 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-68.ec2.internal.18b63231aa793008\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-68.ec2.internal.18b63231aa793008 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-68.ec2.internal,UID:ip-10-0-138-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:51.566465032 +0000 UTC m=+0.381414681,LastTimestamp:2026-06-05 13:24:51.933656036 +0000 UTC m=+0.748605682,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:52.042041 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.041976 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:24:52.047033 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.046606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" Jun 05 13:24:52.171944 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.171910 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Jun 05 13:24:52.350759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.350674 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:52.351596 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.351579 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:52.351681 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.351608 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:52.351681 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.351618 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:52.351681 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.351658 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:52.368010 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.367986 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:52.538577 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:52.538418 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b68af79435ad678ea4ebc6254094909.slice/crio-fef201752467ef39b08ba313b38eb5f4730f2b6845355a23a8f361e3821e8715 WatchSource:0}: Error finding container fef201752467ef39b08ba313b38eb5f4730f2b6845355a23a8f361e3821e8715: Status 404 returned error can't find the container with id fef201752467ef39b08ba313b38eb5f4730f2b6845355a23a8f361e3821e8715 Jun 05 13:24:52.539101 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:24:52.538803 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14f857cc16244b09eb7237ec6ff376b.slice/crio-4a72b53c564e465fb6e939f7328e99e24902eec998d584b9cb60160bae68561a WatchSource:0}: Error finding container 4a72b53c564e465fb6e939f7328e99e24902eec998d584b9cb60160bae68561a: Status 404 returned error can't find the container with id 4a72b53c564e465fb6e939f7328e99e24902eec998d584b9cb60160bae68561a Jun 05 13:24:52.545009 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.544686 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:24:52.547898 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.547809 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63231e4d134c9 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c46116fef319d12c66333805d7ff38d291796e1c1ea1a7407263e914f37c2ea\",Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:52.545311945 +0000 UTC m=+1.360261598,LastTimestamp:2026-06-05 13:24:52.545311945 +0000 UTC m=+1.360261598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:52.547981 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.547912 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:52.554363 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.554285 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-138-68.ec2.internal.18b63231e4e94c26 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-138-68.ec2.internal,UID:b14f857cc16244b09eb7237ec6ff376b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff2a1b99a07e285ee709042ae253d7022ca12b5906327bc8c069bcd0acd749ae\",Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:52.54689079 +0000 UTC m=+1.361840438,LastTimestamp:2026-06-05 13:24:52.54689079 +0000 UTC m=+1.361840438,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:52.562204 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.562184 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:24:52.583686 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.583657 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:24:52.616717 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.616653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" event={"ID":"b14f857cc16244b09eb7237ec6ff376b","Type":"ContainerStarted","Data":"4a72b53c564e465fb6e939f7328e99e24902eec998d584b9cb60160bae68561a"} Jun 05 13:24:52.617583 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.617558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerStarted","Data":"fef201752467ef39b08ba313b38eb5f4730f2b6845355a23a8f361e3821e8715"} Jun 05 13:24:52.726041 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.726021 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:52.726915 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.726901 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:52.726983 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.726930 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:52.726983 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:52.726942 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:52.742626 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.742603 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:24:52.877274 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.877181 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:24:52.981024 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:52.980992 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" Jun 05 13:24:53.168297 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:53.168208 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:53.169482 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:53.169453 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:53.169593 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:53.169497 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:53.169593 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:53.169514 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:53.169593 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:53.169553 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:53.191966 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:53.191941 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:53.545882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:53.545789 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:54.379969 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.379897 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b6323251a3c71e openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c46116fef319d12c66333805d7ff38d291796e1c1ea1a7407263e914f37c2ea\" in 1.825s (1.825s including waiting). Image size: 292844543 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:54.371051294 +0000 UTC m=+3.186000928,LastTimestamp:2026-06-05 13:24:54.371051294 +0000 UTC m=+3.186000928,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:54.393335 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.393310 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:24:54.401048 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.400976 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-138-68.ec2.internal.18b6323252e82b75 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-138-68.ec2.internal,UID:b14f857cc16244b09eb7237ec6ff376b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff2a1b99a07e285ee709042ae253d7022ca12b5906327bc8c069bcd0acd749ae\" in 1.845s (1.845s including waiting). Image size: 331825624 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:54.392310645 +0000 UTC m=+3.207260297,LastTimestamp:2026-06-05 13:24:54.392310645 +0000 UTC m=+3.207260297,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:54.453484 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.453414 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-138-68.ec2.internal.18b6323255fa5f00 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-138-68.ec2.internal,UID:b14f857cc16244b09eb7237ec6ff376b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:54.443835136 +0000 UTC m=+3.258784783,LastTimestamp:2026-06-05 13:24:54.443835136 +0000 UTC m=+3.258784783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:54.461373 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.461302 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-138-68.ec2.internal.18b63232565a239c kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-138-68.ec2.internal,UID:b14f857cc16244b09eb7237ec6ff376b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:54.450111388 +0000 UTC m=+3.265061041,LastTimestamp:2026-06-05 13:24:54.450111388 +0000 UTC m=+3.265061041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:54.546061 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.546029 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:54.559237 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.559193 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:24:54.591102 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.591076 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s" Jun 05 13:24:54.611278 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.611188 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b632325f749efa openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:54.60284185 +0000 UTC m=+3.417791504,LastTimestamp:2026-06-05 13:24:54.60284185 +0000 UTC m=+3.417791504,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:54.621317 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.621203 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b632325fe29f88 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:54.610050952 +0000 UTC m=+3.425000586,LastTimestamp:2026-06-05 13:24:54.610050952 +0000 UTC m=+3.425000586,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:54.622751 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.622722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" event={"ID":"b14f857cc16244b09eb7237ec6ff376b","Type":"ContainerStarted","Data":"0c2b4d619627b0c7be9cef577b4d647aaf94ca161533c7f54a0208a44f482dd9"} Jun 05 13:24:54.622751 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.622746 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:54.623535 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.623518 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:54.623606 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.623550 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:54.623606 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.623566 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:54.623756 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.623739 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:54.624284 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.624262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerStarted","Data":"ac794d4d26963e99b4e71a0716aaeeb573152d5ea9a788a43afbcfccba855079"} Jun 05 13:24:54.624382 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.624318 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:54.625045 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.625029 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:54.625115 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.625055 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:54.625115 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.625064 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:54.625209 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.625197 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:54.793093 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.793045 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:54.794150 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.794129 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:54.794272 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.794169 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:54.794272 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.794182 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:54.794272 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.794207 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:54.809799 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:54.809771 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:54.828828 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.828808 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:54.829701 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.829684 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:54.829783 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.829713 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:54.829783 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:54.829724 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:55.159806 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.159762 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:24:55.546928 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.546855 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:55.627470 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.627428 2579 generic.go:356] "Generic (PLEG): container finished" podID="6b68af79435ad678ea4ebc6254094909" containerID="ac794d4d26963e99b4e71a0716aaeeb573152d5ea9a788a43afbcfccba855079" exitCode=0 Jun 05 13:24:55.627599 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.627493 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:55.627599 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.627514 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:55.627599 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.627510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerDied","Data":"ac794d4d26963e99b4e71a0716aaeeb573152d5ea9a788a43afbcfccba855079"} Jun 05 13:24:55.628293 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.628280 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:55.628412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.628291 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:55.628412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.628304 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:55.628412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.628315 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:55.628412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.628322 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:55.628412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:55.628340 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:55.628638 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.628446 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:55.628638 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.628582 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:55.639025 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.638957 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b632329cb24e3c openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c46116fef319d12c66333805d7ff38d291796e1c1ea1a7407263e914f37c2ea\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:55.630294588 +0000 UTC m=+4.445244221,LastTimestamp:2026-06-05 13:24:55.630294588 +0000 UTC m=+4.445244221,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:55.682930 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.682907 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:24:55.717174 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.717096 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63232a14677d4 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:55.707113428 +0000 UTC m=+4.522063085,LastTimestamp:2026-06-05 13:24:55.707113428 +0000 UTC m=+4.522063085,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:55.726057 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:55.725958 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63232a1b10df0 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:55.714098672 +0000 UTC m=+4.529048329,LastTimestamp:2026-06-05 13:24:55.714098672 +0000 UTC m=+4.529048329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:56.546308 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.546279 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:56.631929 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.631902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/0.log" Jun 05 13:24:56.632558 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.632534 2579 generic.go:356] "Generic (PLEG): container finished" podID="6b68af79435ad678ea4ebc6254094909" containerID="b268f236a599376cfae494820532681e7920fb08770910cf18c8c9c8e394be5b" exitCode=1 Jun 05 13:24:56.632637 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.632570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerDied","Data":"b268f236a599376cfae494820532681e7920fb08770910cf18c8c9c8e394be5b"} Jun 05 13:24:56.632637 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.632605 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:56.633419 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.633405 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:56.633473 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.633432 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:56.633473 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.633442 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:56.633631 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:56.633618 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:56.633675 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:56.633666 2579 scope.go:117] "RemoveContainer" containerID="b268f236a599376cfae494820532681e7920fb08770910cf18c8c9c8e394be5b" Jun 05 13:24:56.646339 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:56.646270 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b632329cb24e3c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b632329cb24e3c openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c46116fef319d12c66333805d7ff38d291796e1c1ea1a7407263e914f37c2ea\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:55.630294588 +0000 UTC m=+4.445244221,LastTimestamp:2026-06-05 13:24:56.636493274 +0000 UTC m=+5.451442931,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:56.726184 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:56.726109 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63232a14677d4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63232a14677d4 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:55.707113428 +0000 UTC m=+4.522063085,LastTimestamp:2026-06-05 13:24:56.716367797 +0000 UTC m=+5.531317430,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:56.734124 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:56.734031 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63232a1b10df0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63232a1b10df0 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:55.714098672 +0000 UTC m=+4.529048329,LastTimestamp:2026-06-05 13:24:56.723813207 +0000 UTC m=+5.538762853,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:57.546958 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.546925 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:57.636051 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.636018 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/1.log" Jun 05 13:24:57.636469 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.636454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/0.log" Jun 05 13:24:57.636809 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.636787 2579 generic.go:356] "Generic (PLEG): container finished" podID="6b68af79435ad678ea4ebc6254094909" containerID="0de75db7ec60f85b891e2638b3f0791e703c3d3122f0707ba08f5b61ee7d11d7" exitCode=1 Jun 05 13:24:57.636892 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.636822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerDied","Data":"0de75db7ec60f85b891e2638b3f0791e703c3d3122f0707ba08f5b61ee7d11d7"} Jun 05 13:24:57.636892 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.636867 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:57.636892 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.636875 2579 scope.go:117] "RemoveContainer" containerID="b268f236a599376cfae494820532681e7920fb08770910cf18c8c9c8e394be5b" Jun 05 13:24:57.637680 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.637662 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:57.637680 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.637689 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:57.637821 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.637699 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:57.638079 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:57.637920 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:57.638079 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:57.637965 2579 scope.go:117] "RemoveContainer" containerID="0de75db7ec60f85b891e2638b3f0791e703c3d3122f0707ba08f5b61ee7d11d7" Jun 05 13:24:57.638147 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:57.638087 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" podUID="6b68af79435ad678ea4ebc6254094909" Jun 05 13:24:57.647121 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:57.647048 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63233145e279a openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909),Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:57.638045594 +0000 UTC m=+6.452995243,LastTimestamp:2026-06-05 13:24:57.638045594 +0000 UTC m=+6.452995243,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:57.799529 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:57.799440 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s" Jun 05 13:24:58.010519 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.010487 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:58.011552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.011530 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:58.011669 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.011569 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:58.011669 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.011589 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:58.011669 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.011625 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:58.027889 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:58.027850 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:58.546330 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.546294 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:58.640269 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.640245 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/1.log" Jun 05 13:24:58.640750 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.640662 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:58.641436 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.641419 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:58.641526 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.641455 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:58.641526 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.641471 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:58.641738 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:58.641721 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:24:58.641795 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:58.641781 2579 scope.go:117] "RemoveContainer" containerID="0de75db7ec60f85b891e2638b3f0791e703c3d3122f0707ba08f5b61ee7d11d7" Jun 05 13:24:58.641934 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:58.641914 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" podUID="6b68af79435ad678ea4ebc6254094909" Jun 05 13:24:58.653381 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:58.653293 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63233145e279a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal.18b63233145e279a openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal,UID:6b68af79435ad678ea4ebc6254094909,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909),Source:EventSource{Component:kubelet,Host:ip-10-0-138-68.ec2.internal,},FirstTimestamp:2026-06-05 13:24:57.638045594 +0000 UTC m=+6.452995243,LastTimestamp:2026-06-05 13:24:58.641882793 +0000 UTC m=+7.456832427,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-68.ec2.internal,}" Jun 05 13:24:59.111336 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:59.111299 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:59.112356 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:59.112336 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:59.112438 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:59.112371 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:59.112438 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:59.112386 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:59.380923 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:24:59.380838 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:24:59.547837 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:24:59.547806 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:25:00.163083 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:00.163051 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:25:00.203988 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:00.203952 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:25:00.547804 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:00.547716 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:25:01.335301 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.335271 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7kn5" Jun 05 13:25:01.342905 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.342883 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7kn5" Jun 05 13:25:01.487966 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.487928 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 13:25:01.552083 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.552058 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:01.568125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.568106 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:01.613037 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:01.612968 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:01.629693 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.629671 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:01.655245 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.655207 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:25:01.900069 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.899999 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:01.900069 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:01.900027 2579 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:01.938697 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.938675 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:01.957595 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:01.957575 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.016486 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.016468 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.287811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.287744 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.287811 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:02.287774 2579 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.348230 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.348168 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 13:20:01 +0000 UTC" deadline="2028-03-05 00:10:23.647632026 +0000 UTC" Jun 05 13:25:02.348230 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.348211 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15322h45m21.299424299s" Jun 05 13:25:02.540642 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.540577 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.556891 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.556870 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.614513 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.614489 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.883262 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:02.883149 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:02.883262 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:02.883175 2579 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-138-68.ec2.internal" not found Jun 05 13:25:04.205528 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.205498 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-68.ec2.internal\" not found" node="ip-10-0-138-68.ec2.internal" Jun 05 13:25:04.427957 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:04.427908 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:25:04.428989 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:04.428972 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:25:04.429068 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:04.429010 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:25:04.429068 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:04.429022 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:25:04.429068 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:04.429051 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:25:04.439185 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:04.439167 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-68.ec2.internal" Jun 05 13:25:04.439258 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.439191 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-68.ec2.internal\": node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:04.454861 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.454838 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:04.555902 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.555814 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:04.656623 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.656601 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:04.757618 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.757591 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:04.858319 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.858249 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:04.958754 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:04.958732 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.059592 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.059553 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.160074 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.160009 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.260591 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.260550 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.361005 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.360973 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.461565 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.461499 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.562599 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.562565 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.663170 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.663142 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.763747 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.763655 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.864123 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.864085 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:05.965004 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:05.964965 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.065801 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.065746 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.166205 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.166177 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.267087 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.267050 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.368032 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.367952 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.468514 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.468475 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.568590 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.568554 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.669663 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.669603 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.770645 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.770610 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.871077 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.871044 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:06.971633 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:06.971566 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.072275 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.072241 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.172804 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.172772 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.273866 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.273801 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.374129 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.374101 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.474687 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.474645 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.507757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:07.507725 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:25:07.575760 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.575696 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.676594 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.676557 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.777041 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.777005 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.877390 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.877298 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:07.977766 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:07.977744 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.068087 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:08.068059 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:25:08.078262 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.078237 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.179260 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.179198 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.279788 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.279745 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.380320 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.380274 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.481167 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.481078 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.582062 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.582026 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.609223 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:08.609200 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:25:08.610251 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:08.610233 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:25:08.610337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:08.610263 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:25:08.610337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:08.610275 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:25:08.682662 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.682613 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.783142 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.783065 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.883665 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.883624 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:08.984119 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:08.984074 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.084959 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.084890 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.185836 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.185809 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.286319 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.286266 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.386866 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.386788 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.487289 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.487257 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.588261 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.588202 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.689044 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.688961 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.789515 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.789482 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.889967 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.889936 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:09.990490 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:09.990419 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.091552 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.091520 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.191940 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.191891 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.292809 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.292720 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.393185 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.393141 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.493755 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.493716 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.594150 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.594089 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.694965 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.694926 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.795994 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.795944 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.896511 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.896432 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:10.997564 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:10.997523 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:11.098139 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.098106 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:11.199158 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.199074 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:11.299614 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.299575 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-68.ec2.internal\" not found" Jun 05 13:25:11.368198 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.368175 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:25:11.445593 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.445555 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" Jun 05 13:25:11.460304 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.460246 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:25:11.461231 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.461207 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" Jun 05 13:25:11.467613 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.467597 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:25:11.536475 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.536444 2579 apiserver.go:52] "Watching apiserver" Jun 05 13:25:11.544091 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.544063 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 13:25:11.544458 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.544432 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-89bh6","kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal","openshift-multus/network-metrics-daemon-pkp4h","openshift-network-diagnostics/network-check-target-r2c6m","openshift-network-operator/iptables-alerter-mvx7f","openshift-ovn-kubernetes/ovnkube-node-7drzg","kube-system/konnectivity-agent-f8j9h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7","openshift-cluster-node-tuning-operator/tuned-knpjs","openshift-dns/node-resolver-c4f4r","openshift-image-registry/node-ca-bxpq6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal","openshift-multus/multus-2tqdq","openshift-multus/multus-additional-cni-plugins-r9qn9"] Jun 05 13:25:11.546940 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.546918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.548880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.548862 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.549445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.549426 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 13:25:11.549559 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.549542 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 13:25:11.549613 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.549574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z7jnp\"" Jun 05 13:25:11.550901 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.550879 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wdh55\"" Jun 05 13:25:11.550994 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.550883 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:11.551055 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.550990 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:11.551331 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.551316 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.551406 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.551385 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 13:25:11.551458 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.551428 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 13:25:11.551918 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.551902 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.553185 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.553166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:11.553295 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.553243 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:11.554828 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.554812 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 13:25:11.555149 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.555134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.555516 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.555498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3297204-7d3a-41fc-9e8f-e4263bf1745b-agent-certs\") pod \"konnectivity-agent-f8j9h\" (UID: \"d3297204-7d3a-41fc-9e8f-e4263bf1745b\") " pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.555615 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.555528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3297204-7d3a-41fc-9e8f-e4263bf1745b-konnectivity-ca\") pod \"konnectivity-agent-f8j9h\" (UID: \"d3297204-7d3a-41fc-9e8f-e4263bf1745b\") " pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.557366 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.557349 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.557612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.557582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.557924 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.557902 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vqdz\"" Jun 05 13:25:11.560401 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.558481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.560401 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.558578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 13:25:11.560401 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.559796 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 13:25:11.560401 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.560193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.560401 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.560300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9cxjk\"" Jun 05 13:25:11.561339 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.561305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.562026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.561705 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 13:25:11.562026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.561750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 13:25:11.562026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.561865 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.562026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.561901 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 13:25:11.564071 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.564047 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.564151 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.564120 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qb4ng\"" Jun 05 13:25:11.564235 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.564152 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.564235 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.564159 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.564341 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.564238 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:11.566562 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.566544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.568809 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.568785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xqcpt\"" Jun 05 13:25:11.568895 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.568810 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 13:25:11.568895 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.568881 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.569103 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.569081 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 13:25:11.569922 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.569899 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:25:11.571047 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.571030 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.571047 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.571037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zn2lg\"" Jun 05 13:25:11.571189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.571105 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.571306 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.571292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.573264 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.573249 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.573643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.573486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.573643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.573537 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dwsv6\"" Jun 05 13:25:11.573643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.573580 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 13:25:11.573811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.573670 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.574153 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.574138 2579 scope.go:117] "RemoveContainer" containerID="0de75db7ec60f85b891e2638b3f0791e703c3d3122f0707ba08f5b61ee7d11d7" Jun 05 13:25:11.575874 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.575852 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 13:25:11.575874 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.575868 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 13:25:11.576055 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.575921 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95j7p\"" Jun 05 13:25:11.576141 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.576126 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 13:25:11.647124 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.647106 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 13:25:11.656948 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.656918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-multus-certs\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.657036 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.656951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-kubelet\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657036 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.656977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-run-netns\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-modprobe-d\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.657138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966rh\" (UniqueName: \"kubernetes.io/projected/d95a3ebb-2ee4-4a4f-a10c-50406058f897-kube-api-access-966rh\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.657138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3297204-7d3a-41fc-9e8f-e4263bf1745b-konnectivity-ca\") pod \"konnectivity-agent-f8j9h\" (UID: \"d3297204-7d3a-41fc-9e8f-e4263bf1745b\") " pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.657138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-os-release\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.657334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-kubelet\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.657334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-daemon-config\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.657334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-ovn\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-cni-bin\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a04c5bdb-957a-4fd2-b97a-d462c80c807f-hosts-file\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.657334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxf99\" (UniqueName: \"kubernetes.io/projected/a04c5bdb-957a-4fd2-b97a-d462c80c807f-kube-api-access-sxf99\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-etc-kubernetes\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-systemd-units\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-registration-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-cnibin\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-slash\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-run-ovn-kubernetes\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-ovnkube-script-lib\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657547 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-kubernetes\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-socket-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-sys-fs\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.657640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-cni-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-socket-dir-parent\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3297204-7d3a-41fc-9e8f-e4263bf1745b-konnectivity-ca\") pod \"konnectivity-agent-f8j9h\" (UID: \"d3297204-7d3a-41fc-9e8f-e4263bf1745b\") " pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-host\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-lib-modules\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-dbus\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-system-cni-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-conf-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysctl-conf\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-run\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-tmp\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq4x4\" (UniqueName: \"kubernetes.io/projected/eb813a45-e57d-4e13-91ed-4c6e3619223d-kube-api-access-rq4x4\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-system-cni-dir\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.657978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-cnibin\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqfb2\" (UniqueName: \"kubernetes.io/projected/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-kube-api-access-sqfb2\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-ovnkube-config\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-host\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb813a45-e57d-4e13-91ed-4c6e3619223d-host-slash\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-os-release\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysconfig\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-k8s-cni-cncf-io\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1bd777f-221f-4780-ab4b-313e42b82381-ovn-node-metrics-cert\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-sys\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-var-lib-kubelet\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-device-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-cni-bin\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-var-lib-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.658666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-cni-netd\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-kubelet-config\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfx7w\" (UniqueName: \"kubernetes.io/projected/49a453a5-c753-4d32-95bb-2d5bd4e44e13-kube-api-access-xfx7w\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysctl-d\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-systemd\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3297204-7d3a-41fc-9e8f-e4263bf1745b-agent-certs\") pod \"konnectivity-agent-f8j9h\" (UID: \"d3297204-7d3a-41fc-9e8f-e4263bf1745b\") " pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb813a45-e57d-4e13-91ed-4c6e3619223d-iptables-alerter-script\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-cni-multus\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjgm\" (UniqueName: \"kubernetes.io/projected/f1bd777f-221f-4780-ab4b-313e42b82381-kube-api-access-dhjgm\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04c5bdb-957a-4fd2-b97a-d462c80c807f-tmp-dir\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-etc-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-node-log\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-log-socket\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbv6q\" (UniqueName: \"kubernetes.io/projected/0eb1884f-3556-45a1-9454-c03c4c5cc683-kube-api-access-kbv6q\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-serviceca\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.659292 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blfv5\" (UniqueName: \"kubernetes.io/projected/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-kube-api-access-blfv5\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-hostroot\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.658983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-systemd\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-cni-binary-copy\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-netns\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-env-overrides\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-tuned\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659159 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxk4\" (UniqueName: \"kubernetes.io/projected/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-kube-api-access-5kxk4\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.659916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.659576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.662208 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.662187 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/1.log" Jun 05 13:25:11.663623 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.663600 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3297204-7d3a-41fc-9e8f-e4263bf1745b-agent-certs\") pod \"konnectivity-agent-f8j9h\" (UID: \"d3297204-7d3a-41fc-9e8f-e4263bf1745b\") " pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.723608 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.723519 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-68.ec2.internal" podStartSLOduration=0.723503889 podStartE2EDuration="723.503889ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:11.723457418 +0000 UTC m=+20.538407071" watchObservedRunningTime="2026-06-05 13:25:11.723503889 +0000 UTC m=+20.538453546" Jun 05 13:25:11.760103 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb813a45-e57d-4e13-91ed-4c6e3619223d-host-slash\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-os-release\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysconfig\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-k8s-cni-cncf-io\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb813a45-e57d-4e13-91ed-4c6e3619223d-host-slash\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-k8s-cni-cncf-io\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760243 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysconfig\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.760282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-os-release\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760301 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1bd777f-221f-4780-ab4b-313e42b82381-ovn-node-metrics-cert\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-sys\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-var-lib-kubelet\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-device-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-sys\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760445 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-device-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-var-lib-kubelet\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-cni-bin\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760515 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-cni-bin\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-var-lib-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-cni-netd\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-kubelet-config\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-var-lib-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfx7w\" (UniqueName: \"kubernetes.io/projected/49a453a5-c753-4d32-95bb-2d5bd4e44e13-kube-api-access-xfx7w\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:11.760626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysctl-d\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-cni-netd\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-kubelet-config\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-systemd\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760746 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysctl-d\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb813a45-e57d-4e13-91ed-4c6e3619223d-iptables-alerter-script\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-systemd\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-cni-multus\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjgm\" (UniqueName: \"kubernetes.io/projected/f1bd777f-221f-4780-ab4b-313e42b82381-kube-api-access-dhjgm\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-cni-multus\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04c5bdb-957a-4fd2-b97a-d462c80c807f-tmp-dir\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-etc-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-node-log\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.760979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-etc-openvswitch\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.761307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-node-log\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-log-socket\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbv6q\" (UniqueName: \"kubernetes.io/projected/0eb1884f-3556-45a1-9454-c03c4c5cc683-kube-api-access-kbv6q\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-serviceca\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blfv5\" (UniqueName: \"kubernetes.io/projected/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-kube-api-access-blfv5\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761132 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-log-socket\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-hostroot\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-systemd\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-hostroot\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-cni-binary-copy\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-netns\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-env-overrides\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-tuned\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761376 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb813a45-e57d-4e13-91ed-4c6e3619223d-iptables-alerter-script\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxk4\" (UniqueName: \"kubernetes.io/projected/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-kube-api-access-5kxk4\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.761790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-multus-certs\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-kubelet\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-serviceca\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-run-netns\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-netns\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-modprobe-d\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966rh\" (UniqueName: \"kubernetes.io/projected/d95a3ebb-2ee4-4a4f-a10c-50406058f897-kube-api-access-966rh\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-os-release\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-kubelet\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761592 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-daemon-config\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-ovn\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-cni-bin\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a04c5bdb-957a-4fd2-b97a-d462c80c807f-hosts-file\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxf99\" (UniqueName: \"kubernetes.io/projected/a04c5bdb-957a-4fd2-b97a-d462c80c807f-kube-api-access-sxf99\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-etc-kubernetes\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-systemd-units\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.762538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-registration-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-cnibin\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-slash\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761902 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04c5bdb-957a-4fd2-b97a-d462c80c807f-tmp-dir\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-run-ovn-kubernetes\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-ovnkube-script-lib\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-kubernetes\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761974 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-socket-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761995 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-env-overrides\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-sys-fs\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-cni-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762084 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-run-multus-certs\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-os-release\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-socket-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-socket-dir-parent\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-sys-fs\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-host\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762194 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-modprobe-d\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-socket-dir-parent\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-lib-modules\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-host-var-lib-kubelet\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-run-netns\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-dbus\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-system-cni-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-cni-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-conf-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762385 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-lib-modules\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761632 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-systemd\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.762105 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysctl-conf\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.764880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762428 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-host\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.762464 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:12.262444327 +0000 UTC m=+21.077393979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762469 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-run-ovn\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-dbus\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-cni-bin\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-systemd-units\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.761657 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-kubelet\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762508 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-sysctl-conf\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.762240 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-slash\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-run\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.762626 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:12.26260936 +0000 UTC m=+21.077559005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-registration-dir\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-cnibin\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-tmp\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.765813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762680 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-run\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq4x4\" (UniqueName: \"kubernetes.io/projected/eb813a45-e57d-4e13-91ed-4c6e3619223d-kube-api-access-rq4x4\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95a3ebb-2ee4-4a4f-a10c-50406058f897-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-system-cni-dir\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-system-cni-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-cnibin\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1bd777f-221f-4780-ab4b-313e42b82381-host-run-ovn-kubernetes\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-daemon-config\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-kubernetes\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqfb2\" (UniqueName: \"kubernetes.io/projected/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-kube-api-access-sqfb2\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-multus-conf-dir\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-ovnkube-config\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-host\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-host\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-cnibin\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.762812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a04c5bdb-957a-4fd2-b97a-d462c80c807f-hosts-file\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-etc-kubernetes\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:11.766589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1884f-3556-45a1-9454-c03c4c5cc683-system-cni-dir\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-cni-binary-copy\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763516 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-ovnkube-config\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1bd777f-221f-4780-ab4b-313e42b82381-ovnkube-script-lib\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763700 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1bd777f-221f-4780-ab4b-313e42b82381-ovn-node-metrics-cert\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.763808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0eb1884f-3556-45a1-9454-c03c4c5cc683-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.764440 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-etc-tuned\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.767459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.764697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-tmp\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.770825 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.770803 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:11.770929 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.770830 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:11.770929 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.770845 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:11.770929 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:11.770906 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:25:12.270888305 +0000 UTC m=+21.085837939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:11.771663 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.771638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjgm\" (UniqueName: \"kubernetes.io/projected/f1bd777f-221f-4780-ab4b-313e42b82381-kube-api-access-dhjgm\") pod \"ovnkube-node-7drzg\" (UID: \"f1bd777f-221f-4780-ab4b-313e42b82381\") " pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.772246 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.772205 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxk4\" (UniqueName: \"kubernetes.io/projected/cf73ca6f-2e1b-4ba4-9945-10ec1c75e667-kube-api-access-5kxk4\") pod \"tuned-knpjs\" (UID: \"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667\") " pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.772371 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.772332 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blfv5\" (UniqueName: \"kubernetes.io/projected/6748f1dc-bb7c-4921-9543-fbc7b0c0f508-kube-api-access-blfv5\") pod \"node-ca-bxpq6\" (UID: \"6748f1dc-bb7c-4921-9543-fbc7b0c0f508\") " pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.772624 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.772597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxf99\" (UniqueName: \"kubernetes.io/projected/a04c5bdb-957a-4fd2-b97a-d462c80c807f-kube-api-access-sxf99\") pod \"node-resolver-c4f4r\" (UID: \"a04c5bdb-957a-4fd2-b97a-d462c80c807f\") " pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.772729 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.772676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbv6q\" (UniqueName: \"kubernetes.io/projected/0eb1884f-3556-45a1-9454-c03c4c5cc683-kube-api-access-kbv6q\") pod \"multus-additional-cni-plugins-r9qn9\" (UID: \"0eb1884f-3556-45a1-9454-c03c4c5cc683\") " pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.772729 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.772721 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfx7w\" (UniqueName: \"kubernetes.io/projected/49a453a5-c753-4d32-95bb-2d5bd4e44e13-kube-api-access-xfx7w\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:11.772901 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.772878 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966rh\" (UniqueName: \"kubernetes.io/projected/d95a3ebb-2ee4-4a4f-a10c-50406058f897-kube-api-access-966rh\") pod \"aws-ebs-csi-driver-node-7hdm7\" (UID: \"d95a3ebb-2ee4-4a4f-a10c-50406058f897\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.773591 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.773573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq4x4\" (UniqueName: \"kubernetes.io/projected/eb813a45-e57d-4e13-91ed-4c6e3619223d-kube-api-access-rq4x4\") pod \"iptables-alerter-mvx7f\" (UID: \"eb813a45-e57d-4e13-91ed-4c6e3619223d\") " pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.773753 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.773738 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqfb2\" (UniqueName: \"kubernetes.io/projected/c55c0aea-bc6e-47b7-8d1d-40ef51e108af-kube-api-access-sqfb2\") pod \"multus-2tqdq\" (UID: \"c55c0aea-bc6e-47b7-8d1d-40ef51e108af\") " pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.857256 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.857208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:11.863395 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.863376 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tqdq" Jun 05 13:25:11.868445 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.868421 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3297204_7d3a_41fc_9e8f_e4263bf1745b.slice/crio-e2916c344b681d917088a1994d5247fa753d92231ea149f8eaacc9d5e260b3a4 WatchSource:0}: Error finding container e2916c344b681d917088a1994d5247fa753d92231ea149f8eaacc9d5e260b3a4: Status 404 returned error can't find the container with id e2916c344b681d917088a1994d5247fa753d92231ea149f8eaacc9d5e260b3a4 Jun 05 13:25:11.869355 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.869329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mvx7f" Jun 05 13:25:11.873270 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.873246 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55c0aea_bc6e_47b7_8d1d_40ef51e108af.slice/crio-52b416364f07797bfe127a868f57b901900022a9991f7017156f519de6126f00 WatchSource:0}: Error finding container 52b416364f07797bfe127a868f57b901900022a9991f7017156f519de6126f00: Status 404 returned error can't find the container with id 52b416364f07797bfe127a868f57b901900022a9991f7017156f519de6126f00 Jun 05 13:25:11.877149 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.877128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:11.878532 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.878514 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb813a45_e57d_4e13_91ed_4c6e3619223d.slice/crio-99354bb44ddc65a7fe1bcd5e168e8e16a76c42a7b388bd5a0a66111dd8c39d39 WatchSource:0}: Error finding container 99354bb44ddc65a7fe1bcd5e168e8e16a76c42a7b388bd5a0a66111dd8c39d39: Status 404 returned error can't find the container with id 99354bb44ddc65a7fe1bcd5e168e8e16a76c42a7b388bd5a0a66111dd8c39d39 Jun 05 13:25:11.881577 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.881559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-knpjs" Jun 05 13:25:11.886570 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.886551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" Jun 05 13:25:11.886701 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.886684 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bd777f_221f_4780_ab4b_313e42b82381.slice/crio-234ba95add673a76faf0b301bd645a87d8a3611e7f5b4a915a6d9d858410a794 WatchSource:0}: Error finding container 234ba95add673a76faf0b301bd645a87d8a3611e7f5b4a915a6d9d858410a794: Status 404 returned error can't find the container with id 234ba95add673a76faf0b301bd645a87d8a3611e7f5b4a915a6d9d858410a794 Jun 05 13:25:11.890712 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.890685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf73ca6f_2e1b_4ba4_9945_10ec1c75e667.slice/crio-db3144ef8ac5d479aa835d0c80c80f1f6185fc37884a03f7de7dd2d177459579 WatchSource:0}: Error finding container db3144ef8ac5d479aa835d0c80c80f1f6185fc37884a03f7de7dd2d177459579: Status 404 returned error can't find the container with id db3144ef8ac5d479aa835d0c80c80f1f6185fc37884a03f7de7dd2d177459579 Jun 05 13:25:11.895208 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.895190 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb1884f_3556_45a1_9454_c03c4c5cc683.slice/crio-c00eb0072481b67edb98e4df2e834b1759faf71dda3eed483a3f4c13cd4be9d3 WatchSource:0}: Error finding container c00eb0072481b67edb98e4df2e834b1759faf71dda3eed483a3f4c13cd4be9d3: Status 404 returned error can't find the container with id c00eb0072481b67edb98e4df2e834b1759faf71dda3eed483a3f4c13cd4be9d3 Jun 05 13:25:11.896775 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.896759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4f4r" Jun 05 13:25:11.903801 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.903784 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxpq6" Jun 05 13:25:11.907958 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.907937 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04c5bdb_957a_4fd2_b97a_d462c80c807f.slice/crio-9d018c681c69def680116ee3d90d179e76d68a0566a389e0acd23e111b7d7421 WatchSource:0}: Error finding container 9d018c681c69def680116ee3d90d179e76d68a0566a389e0acd23e111b7d7421: Status 404 returned error can't find the container with id 9d018c681c69def680116ee3d90d179e76d68a0566a389e0acd23e111b7d7421 Jun 05 13:25:11.911030 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:11.910995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" Jun 05 13:25:11.912900 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.912883 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6748f1dc_bb7c_4921_9543_fbc7b0c0f508.slice/crio-ed3e88b16d31c56b4ae8a0f7f2613ca0e004c6bd7d7a63f4ecb917f795fb716d WatchSource:0}: Error finding container ed3e88b16d31c56b4ae8a0f7f2613ca0e004c6bd7d7a63f4ecb917f795fb716d: Status 404 returned error can't find the container with id ed3e88b16d31c56b4ae8a0f7f2613ca0e004c6bd7d7a63f4ecb917f795fb716d Jun 05 13:25:11.919504 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:11.919487 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95a3ebb_2ee4_4a4f_a10c_50406058f897.slice/crio-2da41322a2353fa8a20ef051425075c3c317e6a299d032c917799e683e581ea9 WatchSource:0}: Error finding container 2da41322a2353fa8a20ef051425075c3c317e6a299d032c917799e683e581ea9: Status 404 returned error can't find the container with id 2da41322a2353fa8a20ef051425075c3c317e6a299d032c917799e683e581ea9 Jun 05 13:25:12.266984 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.266947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:12.267147 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.267020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:12.267147 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.267110 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:12.267283 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.267167 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:13.267153281 +0000 UTC m=+22.082102928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:12.267283 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.267117 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:12.267283 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.267268 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:13.267251247 +0000 UTC m=+22.082200901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:12.368688 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.367996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:12.368688 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.368232 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:12.368688 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.368253 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:12.368688 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.368266 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:12.368688 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.368333 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:25:13.368314011 +0000 UTC m=+22.183263651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:12.673566 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.673471 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-knpjs" event={"ID":"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667","Type":"ContainerStarted","Data":"db3144ef8ac5d479aa835d0c80c80f1f6185fc37884a03f7de7dd2d177459579"} Jun 05 13:25:12.678152 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.677986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"234ba95add673a76faf0b301bd645a87d8a3611e7f5b4a915a6d9d858410a794"} Jun 05 13:25:12.685298 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.685206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tqdq" event={"ID":"c55c0aea-bc6e-47b7-8d1d-40ef51e108af","Type":"ContainerStarted","Data":"52b416364f07797bfe127a868f57b901900022a9991f7017156f519de6126f00"} Jun 05 13:25:12.692029 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.691948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerStarted","Data":"c00eb0072481b67edb98e4df2e834b1759faf71dda3eed483a3f4c13cd4be9d3"} Jun 05 13:25:12.700174 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.700142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mvx7f" event={"ID":"eb813a45-e57d-4e13-91ed-4c6e3619223d","Type":"ContainerStarted","Data":"99354bb44ddc65a7fe1bcd5e168e8e16a76c42a7b388bd5a0a66111dd8c39d39"} Jun 05 13:25:12.704098 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.704057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f8j9h" event={"ID":"d3297204-7d3a-41fc-9e8f-e4263bf1745b","Type":"ContainerStarted","Data":"e2916c344b681d917088a1994d5247fa753d92231ea149f8eaacc9d5e260b3a4"} Jun 05 13:25:12.713358 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.713335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:25:12.717961 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.717624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/1.log" Jun 05 13:25:12.721274 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.721116 2579 generic.go:356] "Generic (PLEG): container finished" podID="6b68af79435ad678ea4ebc6254094909" containerID="3337e04a32c5c3f6b4a1cec3726cca9b15f9e325f57dd370f752ed0a255d682c" exitCode=1 Jun 05 13:25:12.721274 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.721233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerDied","Data":"3337e04a32c5c3f6b4a1cec3726cca9b15f9e325f57dd370f752ed0a255d682c"} Jun 05 13:25:12.721556 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.721287 2579 scope.go:117] "RemoveContainer" containerID="0de75db7ec60f85b891e2638b3f0791e703c3d3122f0707ba08f5b61ee7d11d7" Jun 05 13:25:12.721822 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.721802 2579 scope.go:117] "RemoveContainer" containerID="3337e04a32c5c3f6b4a1cec3726cca9b15f9e325f57dd370f752ed0a255d682c" Jun 05 13:25:12.722012 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:12.721987 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" podUID="6b68af79435ad678ea4ebc6254094909" Jun 05 13:25:12.738786 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.736703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" event={"ID":"d95a3ebb-2ee4-4a4f-a10c-50406058f897","Type":"ContainerStarted","Data":"2da41322a2353fa8a20ef051425075c3c317e6a299d032c917799e683e581ea9"} Jun 05 13:25:12.748942 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.748912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxpq6" event={"ID":"6748f1dc-bb7c-4921-9543-fbc7b0c0f508","Type":"ContainerStarted","Data":"ed3e88b16d31c56b4ae8a0f7f2613ca0e004c6bd7d7a63f4ecb917f795fb716d"} Jun 05 13:25:12.753923 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:12.753331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4f4r" event={"ID":"a04c5bdb-957a-4fd2-b97a-d462c80c807f","Type":"ContainerStarted","Data":"9d018c681c69def680116ee3d90d179e76d68a0566a389e0acd23e111b7d7421"} Jun 05 13:25:13.276766 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.275823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:13.276766 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.275889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:13.276766 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.276046 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:13.276766 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.276107 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:15.276087144 +0000 UTC m=+24.091036781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:13.276766 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.276615 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:13.276766 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.276670 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:15.27665348 +0000 UTC m=+24.091603152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:13.376683 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.376648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:13.377139 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.376814 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:13.377139 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.376838 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:13.377139 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.376853 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:13.377139 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.376915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:25:15.376895223 +0000 UTC m=+24.191844949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:13.615425 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.615343 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:13.615425 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.615376 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:13.615693 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.615354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:13.615693 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.615473 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:13.615693 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.615573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:13.615693 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.615651 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:13.772154 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.772123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:25:13.773205 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:13.773174 2579 scope.go:117] "RemoveContainer" containerID="3337e04a32c5c3f6b4a1cec3726cca9b15f9e325f57dd370f752ed0a255d682c" Jun 05 13:25:13.773413 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:13.773387 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" podUID="6b68af79435ad678ea4ebc6254094909" Jun 05 13:25:14.599074 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:14.599042 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wq6wp" Jun 05 13:25:14.606923 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:14.606894 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wq6wp" Jun 05 13:25:15.292103 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.292064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:15.292299 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.292181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:15.292422 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.292375 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:15.292489 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.292452 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:19.292430514 +0000 UTC m=+28.107380153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:15.293057 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.292967 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:15.293057 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.293031 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:19.293012124 +0000 UTC m=+28.107961762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:15.394331 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.394245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:15.394500 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.394440 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:15.394500 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.394466 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:15.394500 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.394482 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:15.394670 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.394554 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:25:19.394534168 +0000 UTC m=+28.209483813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:15.610282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.610177 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 13:20:14 +0000 UTC" deadline="2028-02-14 06:14:06.204028182 +0000 UTC" Jun 05 13:25:15.610282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.610227 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14848h48m50.593819025s" Jun 05 13:25:15.615190 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.614795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:15.615190 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.614794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:15.615190 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.614919 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:15.615190 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.614992 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:15.615190 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:15.615034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:15.615190 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:15.615101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:16.611451 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:16.611409 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 13:20:14 +0000 UTC" deadline="2028-03-10 21:48:04.482202442 +0000 UTC" Jun 05 13:25:16.611451 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:16.611449 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15464h22m47.870757663s" Jun 05 13:25:17.616858 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:17.616509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:17.616858 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:17.616639 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:17.616858 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:17.616643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:17.616858 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:17.616673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:17.616858 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:17.616745 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:17.616858 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:17.616821 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:19.325656 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:19.325617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:19.326083 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:19.325683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:19.326083 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.325825 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:19.326083 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.325885 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:27.325866232 +0000 UTC m=+36.140815869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:19.326402 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.326319 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:19.326402 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.326371 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:27.326356461 +0000 UTC m=+36.141306097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:19.427095 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:19.427018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:19.427301 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.427170 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:19.427301 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.427213 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:19.427301 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.427251 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:19.427523 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.427307 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:25:27.42729041 +0000 UTC m=+36.242240057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:19.615252 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:19.615165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:19.615583 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.615351 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:19.615782 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:19.615760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:19.615897 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.615875 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:19.616054 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:19.616037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:19.616148 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:19.616128 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:21.614411 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:21.614258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:21.614411 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:21.614395 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:21.615745 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:21.615473 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:21.615745 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:21.615583 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:21.615745 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:21.615619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:21.615745 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:21.615700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:23.613973 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:23.613935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:23.614530 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:23.613936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:23.614530 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:23.613943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:23.614530 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:23.614090 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:23.614530 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:23.614196 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:23.614530 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:23.614334 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:24.614605 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:24.614571 2579 scope.go:117] "RemoveContainer" containerID="3337e04a32c5c3f6b4a1cec3726cca9b15f9e325f57dd370f752ed0a255d682c" Jun 05 13:25:24.615041 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:24.614787 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_openshift-machine-config-operator(6b68af79435ad678ea4ebc6254094909)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" podUID="6b68af79435ad678ea4ebc6254094909" Jun 05 13:25:25.614893 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:25.614424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:25.614893 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:25.614437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:25.614893 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:25.614566 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:25.614893 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:25.614625 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:25.614893 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:25.614437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:25.614893 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:25.614725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:27.391376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:27.391333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:27.391868 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:27.391395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:27.391868 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.391494 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:27.391868 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.391560 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:43.391540043 +0000 UTC m=+52.206489681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:27.391868 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.391494 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:27.391868 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.391669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:43.391639281 +0000 UTC m=+52.206588920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:27.492587 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:27.492551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:27.492776 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.492759 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:27.492828 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.492791 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:27.492828 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.492806 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:27.492908 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.492867 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:25:43.492851835 +0000 UTC m=+52.307801469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:27.614158 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:27.613998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:27.614158 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:27.614036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:27.614158 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:27.614001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:27.614158 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.614121 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:27.614501 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.614199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:27.614501 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:27.614329 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:29.614283 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:29.614243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:29.614830 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:29.614295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:29.614830 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:29.614243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:29.614830 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:29.614401 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:29.614830 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:29.614479 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:29.614830 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:29.614570 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:30.810952 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.810702 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" event={"ID":"d95a3ebb-2ee4-4a4f-a10c-50406058f897","Type":"ContainerStarted","Data":"4918c1e04dc0ff7fbcf71f25595266f7420d57ef974d3f57adba7e9d64c27a91"} Jun 05 13:25:30.812057 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.812029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxpq6" event={"ID":"6748f1dc-bb7c-4921-9543-fbc7b0c0f508","Type":"ContainerStarted","Data":"42a57908f8c8ce602754ef6cb7dd42a427ca421f5a3b27797bb3ee1b51a5ef14"} Jun 05 13:25:30.813325 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.813299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4f4r" event={"ID":"a04c5bdb-957a-4fd2-b97a-d462c80c807f","Type":"ContainerStarted","Data":"7455bfea53aab3d95d819a1480ced11e2f2438809d554501a11db2cbb42f850c"} Jun 05 13:25:30.814749 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.814716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-knpjs" event={"ID":"cf73ca6f-2e1b-4ba4-9945-10ec1c75e667","Type":"ContainerStarted","Data":"6e711067fa643abfed132e50941072fcc938d71a385a6aeb37bb16e10a8c752f"} Jun 05 13:25:30.816944 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.816925 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"3afde7d1b2eaf56ac10ea674dc74c6ec52f4e047149867a13b57e36e245b4675"} Jun 05 13:25:30.817043 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.816988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"ed39802f058893c28291ee296a0423324e3881116a632be9e388030ccc2f84c5"} Jun 05 13:25:30.817043 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.817039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"6c9962e96697c3864a65ca47777118019975fa78eb9ef30356a84f332bc45a88"} Jun 05 13:25:30.818662 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.818626 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tqdq" event={"ID":"c55c0aea-bc6e-47b7-8d1d-40ef51e108af","Type":"ContainerStarted","Data":"946c89c758a084bc43f0d968ebca61146962f213e352a55be433844452e2b912"} Jun 05 13:25:30.820385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.820360 2579 generic.go:356] "Generic (PLEG): container finished" podID="0eb1884f-3556-45a1-9454-c03c4c5cc683" containerID="57aba46358dac67dad59cb5e8a7c54296c5ebe374aed2ad13d1835ca7d1d0b87" exitCode=0 Jun 05 13:25:30.820477 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.820399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerDied","Data":"57aba46358dac67dad59cb5e8a7c54296c5ebe374aed2ad13d1835ca7d1d0b87"} Jun 05 13:25:30.822156 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.822131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f8j9h" event={"ID":"d3297204-7d3a-41fc-9e8f-e4263bf1745b","Type":"ContainerStarted","Data":"366fa63e861a76501645b029e4a06dec21a68bf317d420ce64aa2cb04e1926b6"} Jun 05 13:25:30.831912 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.831859 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxpq6" podStartSLOduration=8.329787995 podStartE2EDuration="26.831839406s" totalImagesPullingTime="18.502051411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:30.831045827 +0000 UTC m=+39.645995485" watchObservedRunningTime="2026-06-05 13:25:30.831839406 +0000 UTC m=+39.646789064" Jun 05 13:25:30.845003 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.844962 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f8j9h" podStartSLOduration=16.448073515 podStartE2EDuration="26.844947073s" totalImagesPullingTime="10.396873558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:30.844651781 +0000 UTC m=+39.659601434" watchObservedRunningTime="2026-06-05 13:25:30.844947073 +0000 UTC m=+39.659896729" Jun 05 13:25:30.860547 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.860507 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-knpjs" podStartSLOduration=8.334698293 podStartE2EDuration="26.860492444s" totalImagesPullingTime="18.525794151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:30.86032076 +0000 UTC m=+39.675270416" watchObservedRunningTime="2026-06-05 13:25:30.860492444 +0000 UTC m=+39.675442099" Jun 05 13:25:30.895381 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.895328 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c4f4r" podStartSLOduration=8.386927932 podStartE2EDuration="26.895305172s" totalImagesPullingTime="18.50837724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:30.894901951 +0000 UTC m=+39.709851610" watchObservedRunningTime="2026-06-05 13:25:30.895305172 +0000 UTC m=+39.710254828" Jun 05 13:25:30.912766 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.912727 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2tqdq" podStartSLOduration=8.33727854 podStartE2EDuration="26.912712556s" totalImagesPullingTime="18.575434016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:30.912537374 +0000 UTC m=+39.727487029" watchObservedRunningTime="2026-06-05 13:25:30.912712556 +0000 UTC m=+39.727662211" Jun 05 13:25:30.915839 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.915811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:30.996584 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:30.996554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:31.097413 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.097329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:31.155446 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.155411 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:31.522913 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.522878 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 13:25:31.615878 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.615851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:31.615878 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.615872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:31.616065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.615964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:31.616065 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:31.615966 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:31.616169 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:31.616062 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:31.616169 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:31.616129 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:31.635447 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.635317 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T13:25:31.522897028Z","UUID":"73c14046-ec17-41f1-a736-50f047fdb10f","Handler":null,"Name":"","Endpoint":""} Jun 05 13:25:31.636879 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.636861 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 13:25:31.636977 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.636896 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 13:25:31.825839 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.825803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mvx7f" event={"ID":"eb813a45-e57d-4e13-91ed-4c6e3619223d","Type":"ContainerStarted","Data":"446ed04f5c608377b6dca89eab8ba42383d64f66a41bf7a76f5b09e2e915ce28"} Jun 05 13:25:31.827619 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.827592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" event={"ID":"d95a3ebb-2ee4-4a4f-a10c-50406058f897","Type":"ContainerStarted","Data":"e3789ec7864b0234e74a6fefec08bc30feef23d399ef54d1212104908dc112ce"} Jun 05 13:25:31.830422 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.830400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"32cbd6b0759fde7fe322550893f29ea82818b1820445c0a5878a6c6d4a6f458a"} Jun 05 13:25:31.830554 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.830477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"f8f2d11e061150ca9b373b4b18b66a634aecd4d9df47ea10e92014c7fa695c36"} Jun 05 13:25:31.830554 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.830534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"b27744e4ece7772868f83f19ad2fe8fdfac9f2e2e227d41746204a8856e18740"} Jun 05 13:25:31.840904 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.840869 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mvx7f" podStartSLOduration=9.304072864 podStartE2EDuration="27.840855356s" totalImagesPullingTime="18.536782492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:31.840683701 +0000 UTC m=+40.655633358" watchObservedRunningTime="2026-06-05 13:25:31.840855356 +0000 UTC m=+40.655805011" Jun 05 13:25:31.857835 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.857814 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:31.858385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:31.858370 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:32.835385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:32.835345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" event={"ID":"d95a3ebb-2ee4-4a4f-a10c-50406058f897","Type":"ContainerStarted","Data":"bd5ad08bad81e674bbe4033b4f63fd0cb71ecc39162f6600b040858deeb51101"} Jun 05 13:25:32.835891 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:32.835467 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:32.836159 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:32.836131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f8j9h" Jun 05 13:25:32.855120 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:32.855076 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hdm7" podStartSLOduration=8.753051163 podStartE2EDuration="28.855063671s" totalImagesPullingTime="20.102012508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:32.854736663 +0000 UTC m=+41.669686319" watchObservedRunningTime="2026-06-05 13:25:32.855063671 +0000 UTC m=+41.670013325" Jun 05 13:25:32.909592 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:32.909561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:33.614367 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:33.614335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:33.614565 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:33.614346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:33.614565 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:33.614463 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:33.614698 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:33.614578 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:33.614698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:33.614346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:33.614698 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:33.614679 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:33.841026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:33.840986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"6589dc896a29fce10288aa110039f242f977486b733c2b5443031d6f9f144868"} Jun 05 13:25:35.615065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:35.614837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:35.615552 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:35.615174 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:35.615552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:35.614837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:35.615552 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:35.614836 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:35.615552 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:35.615337 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:35.615552 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:35.615431 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:36.113969 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.113934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:36.204800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.204599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:36.304684 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.304651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:36.614460 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.614380 2579 scope.go:117] "RemoveContainer" containerID="3337e04a32c5c3f6b4a1cec3726cca9b15f9e325f57dd370f752ed0a255d682c" Jun 05 13:25:36.853066 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.850684 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:25:36.853623 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.853592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" event={"ID":"6b68af79435ad678ea4ebc6254094909","Type":"ContainerStarted","Data":"55e6ceeb87758ab5f94ea1183d06cccb4c98af64c97f0e2583ee44ff0246eaf4"} Jun 05 13:25:36.857047 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.857021 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" event={"ID":"f1bd777f-221f-4780-ab4b-313e42b82381","Type":"ContainerStarted","Data":"a6e27f31963106377c60017ef828dc8030e8c0621c37edb332f960266256aa8c"} Jun 05 13:25:36.857263 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.857242 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:36.857383 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.857309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:36.859052 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.859026 2579 generic.go:356] "Generic (PLEG): container finished" podID="0eb1884f-3556-45a1-9454-c03c4c5cc683" containerID="ac187e157f67f0fe8180588b74a5b72f6405be3c1e1fe3a6ebf2ebff575317b7" exitCode=0 Jun 05 13:25:36.859149 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.859062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerDied","Data":"ac187e157f67f0fe8180588b74a5b72f6405be3c1e1fe3a6ebf2ebff575317b7"} Jun 05 13:25:36.873600 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.873538 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:36.898557 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.898510 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal" podStartSLOduration=25.89849059 podStartE2EDuration="25.89849059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:36.87297815 +0000 UTC m=+45.687927807" watchObservedRunningTime="2026-06-05 13:25:36.89849059 +0000 UTC m=+45.713440224" Jun 05 13:25:36.898917 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:36.898890 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" podStartSLOduration=14.294052357 podStartE2EDuration="32.898882671s" totalImagesPullingTime="18.604830314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:36.897890346 +0000 UTC m=+45.712840002" watchObservedRunningTime="2026-06-05 13:25:36.898882671 +0000 UTC m=+45.713832346" Jun 05 13:25:37.614071 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.614040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:37.614288 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.614040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:37.614288 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:37.614151 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:37.614413 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:37.614281 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:37.614413 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.614043 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:37.614512 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:37.614411 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:37.861840 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.861802 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:37.876494 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.876432 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:25:37.957708 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.957681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89bh6"] Jun 05 13:25:37.957847 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.957774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:37.957886 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:37.957859 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:37.960451 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.960427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r2c6m"] Jun 05 13:25:37.960602 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.960520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:37.960666 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:37.960636 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:37.964731 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.961854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkp4h"] Jun 05 13:25:37.964962 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:37.964893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:37.965474 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:37.965443 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:38.866010 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:38.865983 2579 generic.go:356] "Generic (PLEG): container finished" podID="0eb1884f-3556-45a1-9454-c03c4c5cc683" containerID="ad30614627b0cc6eb039135baa0c1fa80f97e070f66793e9e15917da7d7410f8" exitCode=0 Jun 05 13:25:38.866400 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:38.866074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerDied","Data":"ad30614627b0cc6eb039135baa0c1fa80f97e070f66793e9e15917da7d7410f8"} Jun 05 13:25:39.614333 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:39.614134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:39.614502 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:39.614165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:39.614502 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:39.614427 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:39.614628 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:39.614515 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:39.614628 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:39.614165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:39.614628 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:39.614616 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:39.870799 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:39.870772 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerStarted","Data":"c307036b11baaaf6f5f0ec1901afe9fa20bfd180caf923bca7cb2b3947bbaa19"} Jun 05 13:25:40.875321 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:40.875287 2579 generic.go:356] "Generic (PLEG): container finished" podID="0eb1884f-3556-45a1-9454-c03c4c5cc683" containerID="c307036b11baaaf6f5f0ec1901afe9fa20bfd180caf923bca7cb2b3947bbaa19" exitCode=0 Jun 05 13:25:40.875684 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:40.875348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerDied","Data":"c307036b11baaaf6f5f0ec1901afe9fa20bfd180caf923bca7cb2b3947bbaa19"} Jun 05 13:25:41.615376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:41.615338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:41.615696 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:41.615448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:41.615696 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:41.615494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:41.615696 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:41.615484 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:25:41.615696 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:41.615578 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89bh6" podUID="c81bb32b-2ad3-4501-ab1f-7cc081c038e5" Jun 05 13:25:41.615696 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:41.615661 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r2c6m" podUID="75f1bd40-9d60-4e2d-99d0-0818b5856efb" Jun 05 13:25:43.413764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.413676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:43.413764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.413760 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:43.414260 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.413841 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:43.414260 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.413858 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:43.414260 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.413917 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret podName:c81bb32b-2ad3-4501-ab1f-7cc081c038e5 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:15.413898542 +0000 UTC m=+84.228848198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret") pod "global-pull-secret-syncer-89bh6" (UID: "c81bb32b-2ad3-4501-ab1f-7cc081c038e5") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:25:43.414260 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.413936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:15.41392713 +0000 UTC m=+84.228876763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:25:43.460251 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.460207 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-68.ec2.internal" event="NodeReady" Jun 05 13:25:43.460415 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.460342 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 13:25:43.514129 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.514094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:43.514321 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.514292 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:25:43.514321 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.514312 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:25:43.514321 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.514322 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wjjdj for pod openshift-network-diagnostics/network-check-target-r2c6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:43.514481 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.514378 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj podName:75f1bd40-9d60-4e2d-99d0-0818b5856efb nodeName:}" failed. No retries permitted until 2026-06-05 13:26:15.514362852 +0000 UTC m=+84.329312504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wjjdj" (UniqueName: "kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj") pod "network-check-target-r2c6m" (UID: "75f1bd40-9d60-4e2d-99d0-0818b5856efb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:25:43.519554 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.519513 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kplxt"] Jun 05 13:25:43.534421 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.534386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:43.540562 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.540536 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nf82x"] Jun 05 13:25:43.540715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.540692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.544046 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.544018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 13:25:43.544046 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.544028 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cwhcz\"" Jun 05 13:25:43.544620 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.544507 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 13:25:43.556862 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.556841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kplxt"] Jun 05 13:25:43.556975 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.556931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.558946 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.558541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nf82x"] Jun 05 13:25:43.561700 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.561167 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 13:25:43.562020 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.561881 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 13:25:43.562204 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.562157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 13:25:43.563101 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.562880 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2xqv6\"" Jun 05 13:25:43.613891 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.613868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:25:43.613992 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.613871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:25:43.614060 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.613871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:25:43.614464 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.614445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/885c3cde-1614-4114-a516-cdff6c5b5966-config-volume\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.614556 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.614480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.614556 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.614519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvp4\" (UniqueName: \"kubernetes.io/projected/885c3cde-1614-4114-a516-cdff6c5b5966-kube-api-access-pbvp4\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.614556 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.614550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/885c3cde-1614-4114-a516-cdff6c5b5966-tmp-dir\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.616849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.616831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:25:43.617065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.617011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dnbr4\"" Jun 05 13:25:43.617168 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.617053 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:25:43.617168 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.617053 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:25:43.617332 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.617177 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wcdj7\"" Jun 05 13:25:43.617423 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.617392 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:25:43.664945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.664886 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:43.714847 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.714803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvp4\" (UniqueName: \"kubernetes.io/projected/885c3cde-1614-4114-a516-cdff6c5b5966-kube-api-access-pbvp4\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.714847 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.714846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd513d02-8a9b-45fb-8291-a243be7fab29-cert\") pod \"ingress-canary-nf82x\" (UID: \"cd513d02-8a9b-45fb-8291-a243be7fab29\") " pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.715077 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.714892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/885c3cde-1614-4114-a516-cdff6c5b5966-tmp-dir\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.715077 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.714945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jshcn\" (UniqueName: \"kubernetes.io/projected/cd513d02-8a9b-45fb-8291-a243be7fab29-kube-api-access-jshcn\") pod \"ingress-canary-nf82x\" (UID: \"cd513d02-8a9b-45fb-8291-a243be7fab29\") " pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.715077 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.714971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/885c3cde-1614-4114-a516-cdff6c5b5966-config-volume\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.715077 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.715032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.715310 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.715195 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:43.715310 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:43.715290 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:44.215268506 +0000 UTC m=+53.030218160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:25:43.715415 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.715319 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/885c3cde-1614-4114-a516-cdff6c5b5966-tmp-dir\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.715595 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.715576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/885c3cde-1614-4114-a516-cdff6c5b5966-config-volume\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.731261 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.731234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvp4\" (UniqueName: \"kubernetes.io/projected/885c3cde-1614-4114-a516-cdff6c5b5966-kube-api-access-pbvp4\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:43.752061 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.752026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:43.816106 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.816080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd513d02-8a9b-45fb-8291-a243be7fab29-cert\") pod \"ingress-canary-nf82x\" (UID: \"cd513d02-8a9b-45fb-8291-a243be7fab29\") " pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.816303 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.816140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jshcn\" (UniqueName: \"kubernetes.io/projected/cd513d02-8a9b-45fb-8291-a243be7fab29-kube-api-access-jshcn\") pod \"ingress-canary-nf82x\" (UID: \"cd513d02-8a9b-45fb-8291-a243be7fab29\") " pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.818857 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.818830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd513d02-8a9b-45fb-8291-a243be7fab29-cert\") pod \"ingress-canary-nf82x\" (UID: \"cd513d02-8a9b-45fb-8291-a243be7fab29\") " pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.825822 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.825797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jshcn\" (UniqueName: \"kubernetes.io/projected/cd513d02-8a9b-45fb-8291-a243be7fab29-kube-api-access-jshcn\") pod \"ingress-canary-nf82x\" (UID: \"cd513d02-8a9b-45fb-8291-a243be7fab29\") " pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.869736 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.869687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nf82x" Jun 05 13:25:43.879711 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.879656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:43.948996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:43.948960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:44.219285 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:44.219191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:44.219434 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:44.219354 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:44.219434 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:44.219423 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:45.219406144 +0000 UTC m=+54.034355782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:25:45.226183 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:45.226151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:45.226504 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:45.226311 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:45.226504 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:45.226380 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:47.226356519 +0000 UTC m=+56.041306176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:25:45.363141 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:45.362974 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nf82x"] Jun 05 13:25:45.374115 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:25:45.374087 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd513d02_8a9b_45fb_8291_a243be7fab29.slice/crio-1df3de483639a9cba499d332b06a333e7667050ec35eb5ece5b65982a4dae36f WatchSource:0}: Error finding container 1df3de483639a9cba499d332b06a333e7667050ec35eb5ece5b65982a4dae36f: Status 404 returned error can't find the container with id 1df3de483639a9cba499d332b06a333e7667050ec35eb5ece5b65982a4dae36f Jun 05 13:25:45.888406 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:45.888318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nf82x" event={"ID":"cd513d02-8a9b-45fb-8291-a243be7fab29","Type":"ContainerStarted","Data":"1df3de483639a9cba499d332b06a333e7667050ec35eb5ece5b65982a4dae36f"} Jun 05 13:25:45.890886 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:45.890851 2579 generic.go:356] "Generic (PLEG): container finished" podID="0eb1884f-3556-45a1-9454-c03c4c5cc683" containerID="e9b1d08a0a7351eb4e4982c49e2f2e0d1517f890405d1bd05b124eed4fcf7f4c" exitCode=0 Jun 05 13:25:45.891010 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:45.890898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerDied","Data":"e9b1d08a0a7351eb4e4982c49e2f2e0d1517f890405d1bd05b124eed4fcf7f4c"} Jun 05 13:25:46.896032 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:46.895994 2579 generic.go:356] "Generic (PLEG): container finished" podID="0eb1884f-3556-45a1-9454-c03c4c5cc683" containerID="246eca8a8b35d68b87ad1cfbc4c4646078686938d6ac5f069624489cb2f885a0" exitCode=0 Jun 05 13:25:46.896829 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:46.896069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerDied","Data":"246eca8a8b35d68b87ad1cfbc4c4646078686938d6ac5f069624489cb2f885a0"} Jun 05 13:25:47.241656 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:47.241609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:47.241852 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:47.241777 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:47.241916 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:47.241860 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:51.241835397 +0000 UTC m=+60.056785037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:25:47.901582 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:47.901503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" event={"ID":"0eb1884f-3556-45a1-9454-c03c4c5cc683","Type":"ContainerStarted","Data":"8d07fd187498889ad806dacd74fa00cab0bb1ebe1436534fc3d0ee01231b86ad"} Jun 05 13:25:48.598603 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:48.598406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:48.684003 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:48.683965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:48.905280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:48.905150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nf82x" event={"ID":"cd513d02-8a9b-45fb-8291-a243be7fab29","Type":"ContainerStarted","Data":"88d107ece433074078bae5e3e6592cac325181c5be52739ae41059a790f3ae90"} Jun 05 13:25:48.924530 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:48.924483 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9qn9" podStartSLOduration=14.226867935 podStartE2EDuration="44.924465572s" totalImagesPullingTime="30.697597637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:47.93487181 +0000 UTC m=+56.749821465" watchObservedRunningTime="2026-06-05 13:25:48.924465572 +0000 UTC m=+57.739415228" Jun 05 13:25:48.924769 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:48.924745 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nf82x" podStartSLOduration=3.319996436 podStartE2EDuration="5.924737856s" totalImagesPullingTime="2.60474142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:48.924346631 +0000 UTC m=+57.739296286" watchObservedRunningTime="2026-06-05 13:25:48.924737856 +0000 UTC m=+57.739687511" Jun 05 13:25:50.877762 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:50.877722 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:50.944396 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:50.944359 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:51.008660 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:51.008628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:51.267518 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:51.267482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:51.267660 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:51.267625 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:51.267706 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:51.267690 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:59.267674286 +0000 UTC m=+68.082623920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:25:59.321296 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:25:59.321261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:25:59.321661 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:59.321434 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:59.321661 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:25:59.321514 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:15.321493487 +0000 UTC m=+84.136443140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:26:09.891689 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:09.891575 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7drzg" Jun 05 13:26:12.231540 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:12.231502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:26:12.287245 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:12.287194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:26:14.597902 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:14.597860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:26:15.332445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.332398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:26:15.332641 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:26:15.332519 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:26:15.332641 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:26:15.332587 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:47.332571014 +0000 UTC m=+116.147520648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:26:15.433189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.433151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:26:15.433349 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.433245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:26:15.438072 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.438053 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:26:15.438125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.438061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:26:15.444264 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:26:15.444248 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:26:15.444338 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:26:15.444328 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:19.444313012 +0000 UTC m=+148.259262650 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : secret "metrics-daemon-secret" not found Jun 05 13:26:15.447643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.447616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c81bb32b-2ad3-4501-ab1f-7cc081c038e5-original-pull-secret\") pod \"global-pull-secret-syncer-89bh6\" (UID: \"c81bb32b-2ad3-4501-ab1f-7cc081c038e5\") " pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:26:15.533587 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.533551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:26:15.536163 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.536144 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:26:15.546280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.546262 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:26:15.556668 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.556638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjdj\" (UniqueName: \"kubernetes.io/projected/75f1bd40-9d60-4e2d-99d0-0818b5856efb-kube-api-access-wjjdj\") pod \"network-check-target-r2c6m\" (UID: \"75f1bd40-9d60-4e2d-99d0-0818b5856efb\") " pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:26:15.723972 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.723941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89bh6" Jun 05 13:26:15.736957 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.736929 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wcdj7\"" Jun 05 13:26:15.745253 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.745227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:26:15.874963 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.874905 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89bh6"] Jun 05 13:26:15.878685 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:26:15.878652 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81bb32b_2ad3_4501_ab1f_7cc081c038e5.slice/crio-ab90b91acd949b41995c952f731fe4f33687d0f20efae919cebc65515ae04162 WatchSource:0}: Error finding container ab90b91acd949b41995c952f731fe4f33687d0f20efae919cebc65515ae04162: Status 404 returned error can't find the container with id ab90b91acd949b41995c952f731fe4f33687d0f20efae919cebc65515ae04162 Jun 05 13:26:15.887464 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.887441 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r2c6m"] Jun 05 13:26:15.890794 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:26:15.890770 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f1bd40_9d60_4e2d_99d0_0818b5856efb.slice/crio-65c7933703029b1237e0e26884ca0d96695d9e9c4e3843e8d74cf8a08c1e7f76 WatchSource:0}: Error finding container 65c7933703029b1237e0e26884ca0d96695d9e9c4e3843e8d74cf8a08c1e7f76: Status 404 returned error can't find the container with id 65c7933703029b1237e0e26884ca0d96695d9e9c4e3843e8d74cf8a08c1e7f76 Jun 05 13:26:15.968234 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.968184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r2c6m" event={"ID":"75f1bd40-9d60-4e2d-99d0-0818b5856efb","Type":"ContainerStarted","Data":"65c7933703029b1237e0e26884ca0d96695d9e9c4e3843e8d74cf8a08c1e7f76"} Jun 05 13:26:15.969242 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:15.969202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89bh6" event={"ID":"c81bb32b-2ad3-4501-ab1f-7cc081c038e5","Type":"ContainerStarted","Data":"ab90b91acd949b41995c952f731fe4f33687d0f20efae919cebc65515ae04162"} Jun 05 13:26:20.982620 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:20.982590 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r2c6m" event={"ID":"75f1bd40-9d60-4e2d-99d0-0818b5856efb","Type":"ContainerStarted","Data":"47b188eeb8f51acdca3af0fdea1a1af27aa72cbdfc2ca7836ccf7f75363804a1"} Jun 05 13:26:20.983075 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:20.982727 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:26:20.984000 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:20.983976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89bh6" event={"ID":"c81bb32b-2ad3-4501-ab1f-7cc081c038e5","Type":"ContainerStarted","Data":"99e57978c8da7094c47dbe1ab9f41ed7593d2faa54210580e34cb1d818f220a3"} Jun 05 13:26:20.998813 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:20.998773 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r2c6m" podStartSLOduration=72.633849565 podStartE2EDuration="1m16.998759986s" totalImagesPullingTime="4.364910421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:26:20.998162736 +0000 UTC m=+89.813112392" watchObservedRunningTime="2026-06-05 13:26:20.998759986 +0000 UTC m=+89.813709702" Jun 05 13:26:21.012938 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:21.012885 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-89bh6" podStartSLOduration=72.631391188 podStartE2EDuration="1m17.012871006s" totalImagesPullingTime="4.381479818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:26:21.012192514 +0000 UTC m=+89.827142171" watchObservedRunningTime="2026-06-05 13:26:21.012871006 +0000 UTC m=+89.827820661" Jun 05 13:26:47.342521 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:47.342467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:26:47.343007 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:26:47.342609 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:26:47.343007 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:26:47.342659 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:51.342646983 +0000 UTC m=+180.157596617 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:26:51.988569 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:26:51.988540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r2c6m" Jun 05 13:27:07.340350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:07.340312 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:19.349058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:19.349019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:19.448411 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:19.448388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:27:19.448512 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:19.448494 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:27:19.448560 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:19.448551 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs podName:49a453a5-c753-4d32-95bb-2d5bd4e44e13 nodeName:}" failed. No retries permitted until 2026-06-05 13:29:21.448538523 +0000 UTC m=+270.263488157 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs") pod "network-metrics-daemon-pkp4h" (UID: "49a453a5-c753-4d32-95bb-2d5bd4e44e13") : secret "metrics-daemon-secret" not found Jun 05 13:27:27.226921 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:27.226871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:38.076534 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:38.076442 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:46.552399 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:46.552338 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kplxt" podUID="885c3cde-1614-4114-a516-cdff6c5b5966" Jun 05 13:27:46.628768 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:46.628729 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pkp4h" podUID="49a453a5-c753-4d32-95bb-2d5bd4e44e13" Jun 05 13:27:47.189213 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:47.189181 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kplxt" Jun 05 13:27:51.361364 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:51.361322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:27:51.361836 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:51.361442 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:27:51.361836 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:51.361496 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls podName:885c3cde-1614-4114-a516-cdff6c5b5966 nodeName:}" failed. No retries permitted until 2026-06-05 13:29:53.361481414 +0000 UTC m=+302.176431048 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls") pod "dns-default-kplxt" (UID: "885c3cde-1614-4114-a516-cdff6c5b5966") : secret "dns-default-metrics-tls" not found Jun 05 13:27:52.452908 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.452871 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx"] Jun 05 13:27:52.454574 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.454559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" Jun 05 13:27:52.457529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.457507 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lk76z\"" Jun 05 13:27:52.459049 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.459028 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr"] Jun 05 13:27:52.460820 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.460707 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl"] Jun 05 13:27:52.460820 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.460794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" Jun 05 13:27:52.462882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.462861 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw"] Jun 05 13:27:52.463007 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.462990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:52.464596 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.464575 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.464688 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.464624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.464688 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.464677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nsrs4\"" Jun 05 13:27:52.464800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.464722 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ffdd48847-ld2hm"] Jun 05 13:27:52.464872 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.464855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.465487 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.465466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 13:27:52.465588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.465531 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hltsn\"" Jun 05 13:27:52.465588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.465537 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.465699 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.465482 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.466655 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.466634 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx"] Jun 05 13:27:52.466739 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.466725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.467376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.467323 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 13:27:52.467376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.467350 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hkct7\"" Jun 05 13:27:52.467670 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.467641 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 13:27:52.467727 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.467711 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.467812 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.467795 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.469095 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.469069 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 13:27:52.469095 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.469082 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-87fqc\"" Jun 05 13:27:52.469642 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.469481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 13:27:52.469642 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.469551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 13:27:52.469810 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.469460 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.470010 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.469800 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.470303 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.470288 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 13:27:52.474751 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.474733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl"] Jun 05 13:27:52.477978 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.477959 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr"] Jun 05 13:27:52.484849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.484832 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ffdd48847-ld2hm"] Jun 05 13:27:52.495711 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.495680 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw"] Jun 05 13:27:52.554849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.554817 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd"] Jun 05 13:27:52.559616 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.559589 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ddbbd677-p75gm"] Jun 05 13:27:52.559764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.559731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:52.561402 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.561378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.562067 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.562050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 05 13:27:52.562145 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.562126 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z62h5\"" Jun 05 13:27:52.562355 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.562341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 05 13:27:52.564232 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.564204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 13:27:52.564334 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.564249 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 13:27:52.564400 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.564295 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 13:27:52.564847 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.564832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7c9n\"" Jun 05 13:27:52.569425 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-default-certificate\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.569529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/2b6992f4-2ca7-4125-a97f-d66c85b2b933-kube-api-access-xddrh\") pod \"network-check-source-dbd9cf844-hr5dx\" (UID: \"2b6992f4-2ca7-4125-a97f-d66c85b2b933\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" Jun 05 13:27:52.569529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-stats-auth\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.569529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrqd\" (UniqueName: \"kubernetes.io/projected/958b617c-e62e-4ae8-9789-3eebd8b71fe8-kube-api-access-xfrqd\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.569529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.569754 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:52.569754 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqvjm\" (UniqueName: \"kubernetes.io/projected/559ccec4-98b2-416c-b0a4-d65afd9d8a04-kube-api-access-vqvjm\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:52.569754 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.569754 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569709 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 13:27:52.569754 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwp4\" (UniqueName: \"kubernetes.io/projected/be91f03a-98b2-41a2-af18-3f09d17c8250-kube-api-access-gtwp4\") pod \"volume-data-source-validator-78dd696465-fb2vr\" (UID: \"be91f03a-98b2-41a2-af18-3f09d17c8250\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" Jun 05 13:27:52.569965 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-config\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.569965 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnjlh\" (UniqueName: \"kubernetes.io/projected/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-kube-api-access-qnjlh\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.569965 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.569851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.575107 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.575083 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd"] Jun 05 13:27:52.577748 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.577726 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ddbbd677-p75gm"] Jun 05 13:27:52.665770 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.665740 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99"] Jun 05 13:27:52.667771 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.667754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.670256 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:52.670397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.670397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:52.670397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2491609e-3caa-488a-b470-c1557a54814a-ca-trust-extracted\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.670397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:52.670397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwp4\" (UniqueName: \"kubernetes.io/projected/be91f03a-98b2-41a2-af18-3f09d17c8250-kube-api-access-gtwp4\") pod \"volume-data-source-validator-78dd696465-fb2vr\" (UID: \"be91f03a-98b2-41a2-af18-3f09d17c8250\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" Jun 05 13:27:52.670397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.670400 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-trusted-ca\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.670403 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670476 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670486 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ltg5h\"" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.670471 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:53.170452697 +0000 UTC m=+181.985402345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : secret "router-metrics-certs-default" not found Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.670543 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls podName:559ccec4-98b2-416c-b0a4-d65afd9d8a04 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:53.170526209 +0000 UTC m=+181.985475843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hmxcl" (UID: "559ccec4-98b2-416c-b0a4-d65afd9d8a04") : secret "samples-operator-tls" not found Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.670561 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:53.17055188 +0000 UTC m=+181.985501514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : configmap references non-existent config key: service-ca.crt Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-image-registry-private-configuration\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670616 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-stats-auth\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670638 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 13:27:52.670702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrqd\" (UniqueName: \"kubernetes.io/projected/958b617c-e62e-4ae8-9789-3eebd8b71fe8-kube-api-access-xfrqd\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-installation-pull-secrets\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7cj\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-kube-api-access-dq7cj\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvjm\" (UniqueName: \"kubernetes.io/projected/559ccec4-98b2-416c-b0a4-d65afd9d8a04-kube-api-access-vqvjm\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-default-certificate\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-config\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnjlh\" (UniqueName: \"kubernetes.io/projected/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-kube-api-access-qnjlh\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.670988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-registry-certificates\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.671030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/2b6992f4-2ca7-4125-a97f-d66c85b2b933-kube-api-access-xddrh\") pod \"network-check-source-dbd9cf844-hr5dx\" (UID: \"2b6992f4-2ca7-4125-a97f-d66c85b2b933\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.671058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-bound-sa-token\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.671598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.671533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-config\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.673373 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.673338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.673513 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.673496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-stats-auth\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.673580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.673554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-default-certificate\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.681254 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.681207 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99"] Jun 05 13:27:52.686811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.686788 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwp4\" (UniqueName: \"kubernetes.io/projected/be91f03a-98b2-41a2-af18-3f09d17c8250-kube-api-access-gtwp4\") pod \"volume-data-source-validator-78dd696465-fb2vr\" (UID: \"be91f03a-98b2-41a2-af18-3f09d17c8250\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" Jun 05 13:27:52.687346 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.687325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddrh\" (UniqueName: \"kubernetes.io/projected/2b6992f4-2ca7-4125-a97f-d66c85b2b933-kube-api-access-xddrh\") pod \"network-check-source-dbd9cf844-hr5dx\" (UID: \"2b6992f4-2ca7-4125-a97f-d66c85b2b933\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" Jun 05 13:27:52.687443 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.687394 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnjlh\" (UniqueName: \"kubernetes.io/projected/8768f77c-60c1-4dbb-ae8c-e1d4a77bd316-kube-api-access-qnjlh\") pod \"service-ca-operator-6bc5ff68f5-vfhgw\" (UID: \"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.687574 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.687549 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrqd\" (UniqueName: \"kubernetes.io/projected/958b617c-e62e-4ae8-9789-3eebd8b71fe8-kube-api-access-xfrqd\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:52.687675 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.687655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqvjm\" (UniqueName: \"kubernetes.io/projected/559ccec4-98b2-416c-b0a4-d65afd9d8a04-kube-api-access-vqvjm\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:52.765026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.764935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" Jun 05 13:27:52.766996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.766963 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:52.771759 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-image-registry-private-configuration\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.771859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-installation-pull-secrets\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.771859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7cj\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-kube-api-access-dq7cj\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.771859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.771859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-registry-certificates\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.772050 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-bound-sa-token\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.772050 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.771933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:52.772050 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx5rl\" (UniqueName: \"kubernetes.io/projected/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-kube-api-access-zx5rl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.772241 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" Jun 05 13:27:52.772241 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.772241 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2491609e-3caa-488a-b470-c1557a54814a-ca-trust-extracted\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.772241 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:52.772448 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.772448 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-trusted-ca\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.772448 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.772392 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 13:27:52.772448 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.772445 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert podName:95d67839-6a9b-4de4-82e3-4ed07fa42ff2 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:53.272426938 +0000 UTC m=+182.087376573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mrtd" (UID: "95d67839-6a9b-4de4-82e3-4ed07fa42ff2") : secret "networking-console-plugin-cert" not found Jun 05 13:27:52.772706 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.772673 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:27:52.772706 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.772688 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddbbd677-p75gm: secret "image-registry-tls" not found Jun 05 13:27:52.772867 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:52.772729 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls podName:2491609e-3caa-488a-b470-c1557a54814a nodeName:}" failed. No retries permitted until 2026-06-05 13:27:53.272714832 +0000 UTC m=+182.087664467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls") pod "image-registry-7ddbbd677-p75gm" (UID: "2491609e-3caa-488a-b470-c1557a54814a") : secret "image-registry-tls" not found Jun 05 13:27:52.772867 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.772667 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2491609e-3caa-488a-b470-c1557a54814a-ca-trust-extracted\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.773557 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.773483 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-registry-certificates\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.773672 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.773654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:52.774307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.774283 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-trusted-ca\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.774667 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.774645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-image-registry-private-configuration\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.774736 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.774691 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-installation-pull-secrets\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.783233 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.783197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7cj\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-kube-api-access-dq7cj\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.783553 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.783532 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-bound-sa-token\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:52.786724 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.786700 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" Jun 05 13:27:52.867971 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.867936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:52.873689 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.873235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.873689 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.873305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx5rl\" (UniqueName: \"kubernetes.io/projected/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-kube-api-access-zx5rl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.873689 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.873361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.874510 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.874310 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.876102 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.876068 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.881550 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.881532 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx5rl\" (UniqueName: \"kubernetes.io/projected/6cec6ea4-724b-4e32-929c-d6cc0e169cf9-kube-api-access-zx5rl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fsn99\" (UID: \"6cec6ea4-724b-4e32-929c-d6cc0e169cf9\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:52.909775 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.909683 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx"] Jun 05 13:27:52.913167 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:27:52.913128 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6992f4_2ca7_4125_a97f_d66c85b2b933.slice/crio-6d7269238dc356172fa176f0dcb7b19a91c7cb2d4d06e135bbcdfbdff7417635 WatchSource:0}: Error finding container 6d7269238dc356172fa176f0dcb7b19a91c7cb2d4d06e135bbcdfbdff7417635: Status 404 returned error can't find the container with id 6d7269238dc356172fa176f0dcb7b19a91c7cb2d4d06e135bbcdfbdff7417635 Jun 05 13:27:52.923236 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.923184 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr"] Jun 05 13:27:52.926885 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:27:52.926854 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe91f03a_98b2_41a2_af18_3f09d17c8250.slice/crio-9218500847f529f8a8b2f5b03d0b672cc8461ed139faf9ee2e7d36323b87e3c3 WatchSource:0}: Error finding container 9218500847f529f8a8b2f5b03d0b672cc8461ed139faf9ee2e7d36323b87e3c3: Status 404 returned error can't find the container with id 9218500847f529f8a8b2f5b03d0b672cc8461ed139faf9ee2e7d36323b87e3c3 Jun 05 13:27:52.942437 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.942410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw"] Jun 05 13:27:52.944885 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:27:52.944860 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8768f77c_60c1_4dbb_ae8c_e1d4a77bd316.slice/crio-40cc749fb8a8cb4814b41f6dcf6d4b692a8c47a078f9cf4051e5c4e649af806f WatchSource:0}: Error finding container 40cc749fb8a8cb4814b41f6dcf6d4b692a8c47a078f9cf4051e5c4e649af806f: Status 404 returned error can't find the container with id 40cc749fb8a8cb4814b41f6dcf6d4b692a8c47a078f9cf4051e5c4e649af806f Jun 05 13:27:52.983204 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:52.983182 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" Jun 05 13:27:53.108371 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.108340 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99"] Jun 05 13:27:53.111729 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:27:53.111703 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cec6ea4_724b_4e32_929c_d6cc0e169cf9.slice/crio-b580c1069877c441d136c7f5c5d2aa8045699be775a7dbfbde882d7ed5f97a88 WatchSource:0}: Error finding container b580c1069877c441d136c7f5c5d2aa8045699be775a7dbfbde882d7ed5f97a88: Status 404 returned error can't find the container with id b580c1069877c441d136c7f5c5d2aa8045699be775a7dbfbde882d7ed5f97a88 Jun 05 13:27:53.176336 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.176294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:53.176525 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.176392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:53.176525 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.176465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:53.176525 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.176476 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:27:53.176682 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.176547 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:54.176527398 +0000 UTC m=+182.991477046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : secret "router-metrics-certs-default" not found Jun 05 13:27:53.176682 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.176547 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:27:53.176682 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.176597 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:54.176581398 +0000 UTC m=+182.991531038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : configmap references non-existent config key: service-ca.crt Jun 05 13:27:53.176682 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.176617 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls podName:559ccec4-98b2-416c-b0a4-d65afd9d8a04 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:54.176608067 +0000 UTC m=+182.991557707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hmxcl" (UID: "559ccec4-98b2-416c-b0a4-d65afd9d8a04") : secret "samples-operator-tls" not found Jun 05 13:27:53.204622 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.204587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" event={"ID":"be91f03a-98b2-41a2-af18-3f09d17c8250","Type":"ContainerStarted","Data":"9218500847f529f8a8b2f5b03d0b672cc8461ed139faf9ee2e7d36323b87e3c3"} Jun 05 13:27:53.206028 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.206001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" event={"ID":"2b6992f4-2ca7-4125-a97f-d66c85b2b933","Type":"ContainerStarted","Data":"83d658fc4540a2b5d6ed8d1c83584f7919441175d6e5c88b60106207bfa5798e"} Jun 05 13:27:53.206159 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.206040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" event={"ID":"2b6992f4-2ca7-4125-a97f-d66c85b2b933","Type":"ContainerStarted","Data":"6d7269238dc356172fa176f0dcb7b19a91c7cb2d4d06e135bbcdfbdff7417635"} Jun 05 13:27:53.207152 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.207128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" event={"ID":"6cec6ea4-724b-4e32-929c-d6cc0e169cf9","Type":"ContainerStarted","Data":"b580c1069877c441d136c7f5c5d2aa8045699be775a7dbfbde882d7ed5f97a88"} Jun 05 13:27:53.208187 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.208166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" event={"ID":"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316","Type":"ContainerStarted","Data":"40cc749fb8a8cb4814b41f6dcf6d4b692a8c47a078f9cf4051e5c4e649af806f"} Jun 05 13:27:53.223772 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.223712 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hr5dx" podStartSLOduration=1.223692942 podStartE2EDuration="1.223692942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:27:53.222398496 +0000 UTC m=+182.037348153" watchObservedRunningTime="2026-06-05 13:27:53.223692942 +0000 UTC m=+182.038642600" Jun 05 13:27:53.277693 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.277658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:53.277831 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.277703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:53.277890 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.277816 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 13:27:53.277928 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.277890 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert podName:95d67839-6a9b-4de4-82e3-4ed07fa42ff2 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:54.277874275 +0000 UTC m=+183.092823913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mrtd" (UID: "95d67839-6a9b-4de4-82e3-4ed07fa42ff2") : secret "networking-console-plugin-cert" not found Jun 05 13:27:53.277928 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.277891 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:27:53.277928 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.277909 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddbbd677-p75gm: secret "image-registry-tls" not found Jun 05 13:27:53.278037 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:53.277957 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls podName:2491609e-3caa-488a-b470-c1557a54814a nodeName:}" failed. No retries permitted until 2026-06-05 13:27:54.277939882 +0000 UTC m=+183.092889521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls") pod "image-registry-7ddbbd677-p75gm" (UID: "2491609e-3caa-488a-b470-c1557a54814a") : secret "image-registry-tls" not found Jun 05 13:27:53.818957 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:53.818918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:54.186331 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.186304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:54.186450 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.186350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:54.186450 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.186422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:54.186553 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.186453 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:27:54.186553 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.186531 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:56.186507208 +0000 UTC m=+185.001456862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : secret "router-metrics-certs-default" not found Jun 05 13:27:54.186666 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.186602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:56.186585103 +0000 UTC m=+185.001534754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : configmap references non-existent config key: service-ca.crt Jun 05 13:27:54.186725 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.186681 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:27:54.186725 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.186719 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls podName:559ccec4-98b2-416c-b0a4-d65afd9d8a04 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:56.186707263 +0000 UTC m=+185.001656915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hmxcl" (UID: "559ccec4-98b2-416c-b0a4-d65afd9d8a04") : secret "samples-operator-tls" not found Jun 05 13:27:54.215426 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.215392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" event={"ID":"be91f03a-98b2-41a2-af18-3f09d17c8250","Type":"ContainerStarted","Data":"2a8f4758d95536c82e8f4bffb2824d146f98704dbb4ea961d1825d2901928ebe"} Jun 05 13:27:54.232350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.232299 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fb2vr" podStartSLOduration=1.02718378 podStartE2EDuration="2.232280252s" totalImagesPullingTime="1.205096472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:27:54.230877656 +0000 UTC m=+183.045827312" watchObservedRunningTime="2026-06-05 13:27:54.232280252 +0000 UTC m=+183.047229911" Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.287700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.287763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.287853 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.287872 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.287886 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddbbd677-p75gm: secret "image-registry-tls" not found Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.287935 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert podName:95d67839-6a9b-4de4-82e3-4ed07fa42ff2 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:56.287913804 +0000 UTC m=+185.102863452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mrtd" (UID: "95d67839-6a9b-4de4-82e3-4ed07fa42ff2") : secret "networking-console-plugin-cert" not found Jun 05 13:27:54.288116 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:54.287955 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls podName:2491609e-3caa-488a-b470-c1557a54814a nodeName:}" failed. No retries permitted until 2026-06-05 13:27:56.287946033 +0000 UTC m=+185.102895672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls") pod "image-registry-7ddbbd677-p75gm" (UID: "2491609e-3caa-488a-b470-c1557a54814a") : secret "image-registry-tls" not found Jun 05 13:27:54.311273 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.311231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:54.412344 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:54.412173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:56.204273 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.204208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.204285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.204363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.204375 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.204443 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:00.204422733 +0000 UTC m=+189.019372374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : secret "router-metrics-certs-default" not found Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.204452 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.204512 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls podName:559ccec4-98b2-416c-b0a4-d65afd9d8a04 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:00.204494406 +0000 UTC m=+189.019444044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hmxcl" (UID: "559ccec4-98b2-416c-b0a4-d65afd9d8a04") : secret "samples-operator-tls" not found Jun 05 13:27:56.204700 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.204571 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:00.204552325 +0000 UTC m=+189.019501964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : configmap references non-existent config key: service-ca.crt Jun 05 13:27:56.225179 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.225144 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" event={"ID":"6cec6ea4-724b-4e32-929c-d6cc0e169cf9","Type":"ContainerStarted","Data":"85d68ffa23ae11c3d56369c8de93838251a48417d1a881f7c85d576f20c29eb7"} Jun 05 13:27:56.226694 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.226663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" event={"ID":"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316","Type":"ContainerStarted","Data":"686aa093b375038d24ed6497f05e0b2dc5edf5b238d9327f7aa35000d22bfcc3"} Jun 05 13:27:56.239922 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.239866 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" podStartSLOduration=1.449163946 podStartE2EDuration="4.23984719s" totalImagesPullingTime="2.790683244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:27:56.239600546 +0000 UTC m=+185.054550204" watchObservedRunningTime="2026-06-05 13:27:56.23984719 +0000 UTC m=+185.054796858" Jun 05 13:27:56.254038 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.253989 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" podStartSLOduration=1.297295583 podStartE2EDuration="4.253970926s" totalImagesPullingTime="2.956675343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:27:56.253492433 +0000 UTC m=+185.068442089" watchObservedRunningTime="2026-06-05 13:27:56.253970926 +0000 UTC m=+185.068920588" Jun 05 13:27:56.305908 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.305863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:27:56.306090 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.306011 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 13:27:56.306090 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.306087 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert podName:95d67839-6a9b-4de4-82e3-4ed07fa42ff2 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:00.306067713 +0000 UTC m=+189.121017353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mrtd" (UID: "95d67839-6a9b-4de4-82e3-4ed07fa42ff2") : secret "networking-console-plugin-cert" not found Jun 05 13:27:56.306542 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.306514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:27:56.306658 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.306605 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:27:56.306658 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.306619 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddbbd677-p75gm: secret "image-registry-tls" not found Jun 05 13:27:56.306658 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:27:56.306659 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls podName:2491609e-3caa-488a-b470-c1557a54814a nodeName:}" failed. No retries permitted until 2026-06-05 13:28:00.306647205 +0000 UTC m=+189.121596852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls") pod "image-registry-7ddbbd677-p75gm" (UID: "2491609e-3caa-488a-b470-c1557a54814a") : secret "image-registry-tls" not found Jun 05 13:27:56.859989 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.859945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:56.953445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:56.953415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:57.254531 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.254498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:57.310792 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.310750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:57.526622 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.526536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:57.557436 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.557402 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86"] Jun 05 13:27:57.559994 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.559973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" Jun 05 13:27:57.562741 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.562721 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9j6ld\"" Jun 05 13:27:57.562836 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.562721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 13:27:57.562836 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.562723 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 13:27:57.570206 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.570187 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86"] Jun 05 13:27:57.624230 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.624183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:57.717108 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.717070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzr97\" (UniqueName: \"kubernetes.io/projected/d3221085-165c-46ee-9fc3-81680a2ea6d1-kube-api-access-tzr97\") pod \"migrator-955ffdf5f-fpd86\" (UID: \"d3221085-165c-46ee-9fc3-81680a2ea6d1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" Jun 05 13:27:57.724091 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.724059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:57.818138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.818047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzr97\" (UniqueName: \"kubernetes.io/projected/d3221085-165c-46ee-9fc3-81680a2ea6d1-kube-api-access-tzr97\") pod \"migrator-955ffdf5f-fpd86\" (UID: \"d3221085-165c-46ee-9fc3-81680a2ea6d1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" Jun 05 13:27:57.825902 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.825867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzr97\" (UniqueName: \"kubernetes.io/projected/d3221085-165c-46ee-9fc3-81680a2ea6d1-kube-api-access-tzr97\") pod \"migrator-955ffdf5f-fpd86\" (UID: \"d3221085-165c-46ee-9fc3-81680a2ea6d1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" Jun 05 13:27:57.869385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.869357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" Jun 05 13:27:57.989614 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:57.989538 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86"] Jun 05 13:27:57.992044 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:27:57.992016 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3221085_165c_46ee_9fc3_81680a2ea6d1.slice/crio-a5d7e9e205e93742aba571e3d9021e1b61ae1b4448b13179c04aeb194fa848a3 WatchSource:0}: Error finding container a5d7e9e205e93742aba571e3d9021e1b61ae1b4448b13179c04aeb194fa848a3: Status 404 returned error can't find the container with id a5d7e9e205e93742aba571e3d9021e1b61ae1b4448b13179c04aeb194fa848a3 Jun 05 13:27:58.238137 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:58.238104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" event={"ID":"d3221085-165c-46ee-9fc3-81680a2ea6d1","Type":"ContainerStarted","Data":"a5d7e9e205e93742aba571e3d9021e1b61ae1b4448b13179c04aeb194fa848a3"} Jun 05 13:27:58.867067 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:58.867043 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4f4r_a04c5bdb-957a-4fd2-b97a-d462c80c807f/dns-node-resolver/0.log" Jun 05 13:27:59.165247 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.165186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:59.244075 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.244045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" event={"ID":"d3221085-165c-46ee-9fc3-81680a2ea6d1","Type":"ContainerStarted","Data":"15f73e152d55a317b4882c3d588386dee59bf7b1f0f26bf6cc406de17a92b84b"} Jun 05 13:27:59.244194 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.244094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" event={"ID":"d3221085-165c-46ee-9fc3-81680a2ea6d1","Type":"ContainerStarted","Data":"a8191aeac427bcd4a01a913ea8595de726da5910a042bf5fe7918d1cad8443df"} Jun 05 13:27:59.261289 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.261243 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-fpd86" podStartSLOduration=1.168904433 podStartE2EDuration="2.261205443s" totalImagesPullingTime="1.09230101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:27:59.259873582 +0000 UTC m=+188.074823237" watchObservedRunningTime="2026-06-05 13:27:59.261205443 +0000 UTC m=+188.076155098" Jun 05 13:27:59.331185 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.331161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:59.431515 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.431484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:27:59.666211 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:27:59.666185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxpq6_6748f1dc-bb7c-4921-9543-fbc7b0c0f508/node-ca/0.log" Jun 05 13:28:00.238535 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:00.238504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:00.238582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:00.238606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.238674 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:08.238658287 +0000 UTC m=+197.053607922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : configmap references non-existent config key: service-ca.crt Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.238704 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.238708 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.238754 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:08.238738788 +0000 UTC m=+197.053688428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : secret "router-metrics-certs-default" not found Jun 05 13:28:00.238921 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.238769 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls podName:559ccec4-98b2-416c-b0a4-d65afd9d8a04 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:08.23876197 +0000 UTC m=+197.053711604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-hmxcl" (UID: "559ccec4-98b2-416c-b0a4-d65afd9d8a04") : secret "samples-operator-tls" not found Jun 05 13:28:00.339179 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:00.339133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:28:00.339341 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:00.339256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:28:00.339402 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.339335 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 13:28:00.339402 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.339345 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:28:00.339496 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.339419 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddbbd677-p75gm: secret "image-registry-tls" not found Jun 05 13:28:00.339496 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.339403 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert podName:95d67839-6a9b-4de4-82e3-4ed07fa42ff2 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:08.339384572 +0000 UTC m=+197.154334229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mrtd" (UID: "95d67839-6a9b-4de4-82e3-4ed07fa42ff2") : secret "networking-console-plugin-cert" not found Jun 05 13:28:00.339496 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:00.339487 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls podName:2491609e-3caa-488a-b470-c1557a54814a nodeName:}" failed. No retries permitted until 2026-06-05 13:28:08.339470861 +0000 UTC m=+197.154420500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls") pod "image-registry-7ddbbd677-p75gm" (UID: "2491609e-3caa-488a-b470-c1557a54814a") : secret "image-registry-tls" not found Jun 05 13:28:00.667263 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:00.667171 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf82x_cd513d02-8a9b-45fb-8291-a243be7fab29/serve-healthcheck-canary/0.log" Jun 05 13:28:01.615116 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:01.615084 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:28:02.983645 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:02.983598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.084183 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.084150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.184940 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.184903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.354500 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.354409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.483630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.483590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.583337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.583307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.683311 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.683282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:03.892849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:03.892812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:04.309583 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:04.309546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:04.673232 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:04.673151 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:04.871737 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:04.871714 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:05.273311 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:05.273277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:05.473792 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:05.473764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:06.075306 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:06.075275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:06.475636 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:06.475603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:06.875388 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:06.875299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:06.930248 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:06.930190 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:07.275384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:07.275347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:07.472145 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:07.472107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:08.070896 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.070860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:08.302385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.302351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:08.302385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.302392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:28:08.302598 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.302470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:08.302643 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:08.302602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle podName:958b617c-e62e-4ae8-9789-3eebd8b71fe8 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:24.302583747 +0000 UTC m=+213.117533383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle") pod "router-default-ffdd48847-ld2hm" (UID: "958b617c-e62e-4ae8-9789-3eebd8b71fe8") : configmap references non-existent config key: service-ca.crt Jun 05 13:28:08.304900 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.304882 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/958b617c-e62e-4ae8-9789-3eebd8b71fe8-metrics-certs\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:08.304964 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.304941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/559ccec4-98b2-416c-b0a4-d65afd9d8a04-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-hmxcl\" (UID: \"559ccec4-98b2-416c-b0a4-d65afd9d8a04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:28:08.380010 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.379921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" Jun 05 13:28:08.403365 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.403337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:28:08.403490 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.403373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:28:08.403553 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:08.403481 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 13:28:08.403587 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:28:08.403554 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert podName:95d67839-6a9b-4de4-82e3-4ed07fa42ff2 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:24.403536931 +0000 UTC m=+213.218486565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mrtd" (UID: "95d67839-6a9b-4de4-82e3-4ed07fa42ff2") : secret "networking-console-plugin-cert" not found Jun 05 13:28:08.405618 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.405591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"image-registry-7ddbbd677-p75gm\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:28:08.476445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.476411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:28:08.505957 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.505929 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl"] Jun 05 13:28:08.603700 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.603664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ddbbd677-p75gm"] Jun 05 13:28:08.607106 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:28:08.607085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2491609e_3caa_488a_b470_c1557a54814a.slice/crio-7a5074a9a3db63d7bfdce03c966a33f2de4cf24be35fa0fc8973ee333fe31df6 WatchSource:0}: Error finding container 7a5074a9a3db63d7bfdce03c966a33f2de4cf24be35fa0fc8973ee333fe31df6: Status 404 returned error can't find the container with id 7a5074a9a3db63d7bfdce03c966a33f2de4cf24be35fa0fc8973ee333fe31df6 Jun 05 13:28:08.673344 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.673312 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:08.876706 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:08.876673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:09.272469 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.272436 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:09.274651 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.274622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" event={"ID":"559ccec4-98b2-416c-b0a4-d65afd9d8a04","Type":"ContainerStarted","Data":"55a789bcc681818dcd6655ad5a2db3ecef4f88fc1f3d34a40411138e34aa1ffe"} Jun 05 13:28:09.276004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.275980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerStarted","Data":"c1e094abcba586b702bc215d9636931320921bdcf68310a2139a518dc16f6118"} Jun 05 13:28:09.276080 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.276017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerStarted","Data":"7a5074a9a3db63d7bfdce03c966a33f2de4cf24be35fa0fc8973ee333fe31df6"} Jun 05 13:28:09.276129 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.276107 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:28:09.296925 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.296866 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podStartSLOduration=17.296845182 podStartE2EDuration="17.296845182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:09.29609982 +0000 UTC m=+198.111049492" watchObservedRunningTime="2026-06-05 13:28:09.296845182 +0000 UTC m=+198.111794843" Jun 05 13:28:09.476668 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.476628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:09.532463 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:09.532376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:10.073803 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:10.073768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:10.671074 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:10.670985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:10.875596 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:10.875562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:11.072723 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:11.072682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:11.268842 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:11.268803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:11.284643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:11.284612 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" event={"ID":"559ccec4-98b2-416c-b0a4-d65afd9d8a04","Type":"ContainerStarted","Data":"629eb72a69101e872b8089752e40f9ebaeb275d66c9d8cc85ef75f29dadedbd6"} Jun 05 13:28:11.284792 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:11.284689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" event={"ID":"559ccec4-98b2-416c-b0a4-d65afd9d8a04","Type":"ContainerStarted","Data":"cec4c7a92e64fc32bd02ec3368d13fe63c66491ab6892cf91961b2605d4b6a8b"} Jun 05 13:28:11.300210 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:11.300168 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-hmxcl" podStartSLOduration=17.508641238 podStartE2EDuration="19.300154871s" totalImagesPullingTime="1.791513633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:11.299579129 +0000 UTC m=+200.114528787" watchObservedRunningTime="2026-06-05 13:28:11.300154871 +0000 UTC m=+200.115104527" Jun 05 13:28:12.274194 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:12.274154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:12.675853 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:12.675752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:12.873039 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:12.873009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:13.080351 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:13.080323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:13.275037 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:13.275002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:13.672319 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:13.672288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:24.317474 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.317426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:24.318042 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.318022 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/958b617c-e62e-4ae8-9789-3eebd8b71fe8-service-ca-bundle\") pod \"router-default-ffdd48847-ld2hm\" (UID: \"958b617c-e62e-4ae8-9789-3eebd8b71fe8\") " pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:24.417954 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.417912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:28:24.420268 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.420245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95d67839-6a9b-4de4-82e3-4ed07fa42ff2-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mrtd\" (UID: \"95d67839-6a9b-4de4-82e3-4ed07fa42ff2\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:28:24.592447 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.592362 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:24.670324 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.670288 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" Jun 05 13:28:24.771596 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.771567 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ffdd48847-ld2hm"] Jun 05 13:28:24.775167 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:28:24.775139 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958b617c_e62e_4ae8_9789_3eebd8b71fe8.slice/crio-1e3a39e5ea45ad783a0928df4ee2f9d58156770619580b7085a6855d5ade74ae WatchSource:0}: Error finding container 1e3a39e5ea45ad783a0928df4ee2f9d58156770619580b7085a6855d5ade74ae: Status 404 returned error can't find the container with id 1e3a39e5ea45ad783a0928df4ee2f9d58156770619580b7085a6855d5ade74ae Jun 05 13:28:24.811263 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:24.811233 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd"] Jun 05 13:28:24.814611 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:28:24.814580 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d67839_6a9b_4de4_82e3_4ed07fa42ff2.slice/crio-0fe5784cbd800bfebb43b9dea999dcc1329f76235d526c6508202a954446b4cf WatchSource:0}: Error finding container 0fe5784cbd800bfebb43b9dea999dcc1329f76235d526c6508202a954446b4cf: Status 404 returned error can't find the container with id 0fe5784cbd800bfebb43b9dea999dcc1329f76235d526c6508202a954446b4cf Jun 05 13:28:25.330921 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:25.330890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ffdd48847-ld2hm" event={"ID":"958b617c-e62e-4ae8-9789-3eebd8b71fe8","Type":"ContainerStarted","Data":"dd262f0b4770c6c7d31dbcb60d6ca15a643c1153fd4364fcdec6cca9b7b84f09"} Jun 05 13:28:25.331394 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:25.330951 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ffdd48847-ld2hm" event={"ID":"958b617c-e62e-4ae8-9789-3eebd8b71fe8","Type":"ContainerStarted","Data":"1e3a39e5ea45ad783a0928df4ee2f9d58156770619580b7085a6855d5ade74ae"} Jun 05 13:28:25.332044 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:25.332023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" event={"ID":"95d67839-6a9b-4de4-82e3-4ed07fa42ff2","Type":"ContainerStarted","Data":"0fe5784cbd800bfebb43b9dea999dcc1329f76235d526c6508202a954446b4cf"} Jun 05 13:28:25.349915 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:25.349861 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ffdd48847-ld2hm" podStartSLOduration=33.349845745 podStartE2EDuration="33.349845745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:25.34961423 +0000 UTC m=+214.164563886" watchObservedRunningTime="2026-06-05 13:28:25.349845745 +0000 UTC m=+214.164795400" Jun 05 13:28:25.592550 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:25.592472 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:25.595088 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:25.595058 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:26.336419 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.336339 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" event={"ID":"95d67839-6a9b-4de4-82e3-4ed07fa42ff2","Type":"ContainerStarted","Data":"813c7c41f41ed2c59a08ddbda27a8d3c07b8a4ec4af48b3f080c8956203df1f2"} Jun 05 13:28:26.336835 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.336624 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:26.338189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.338170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ffdd48847-ld2hm" Jun 05 13:28:26.353411 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.353370 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mrtd" podStartSLOduration=33.101037091 podStartE2EDuration="34.353357824s" totalImagesPullingTime="1.252320733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:26.352168605 +0000 UTC m=+215.167118260" watchObservedRunningTime="2026-06-05 13:28:26.353357824 +0000 UTC m=+215.168307479" Jun 05 13:28:26.656243 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.656138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:26.759657 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.759623 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:26.857197 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:26.857166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:27.067895 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:27.067859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:27.845197 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:27.845162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:28.481870 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:28.481836 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:28.482055 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:28.481889 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:30.284935 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:30.284903 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:30.285317 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:30.284953 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:34.316908 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:34.316872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:38.481315 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:38.481279 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:38.481710 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:38.481340 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:38.763755 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:38.763645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:38.865500 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:38.865457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:39.431680 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:39.431652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:39.533426 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:39.533391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:39.837469 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:39.837386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:39.892400 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:39.892357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:40.234610 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:40.234573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:40.285488 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:40.285457 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:40.285660 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:40.285513 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:40.292489 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:40.292460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:40.448515 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:40.448483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:40.647581 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:40.647485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:41.114692 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:41.114650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:41.663926 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:41.663890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:41.714756 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:41.714723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:48.480458 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:48.480429 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:48.480835 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:48.480489 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:48.480835 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:48.480525 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:28:48.481051 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:48.481009 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"c1e094abcba586b702bc215d9636931320921bdcf68310a2139a518dc16f6118"} pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:28:48.484586 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:48.484563 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:48.484696 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:48.484610 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:51.070066 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:51.070022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:52.471996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:52.471959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:52.527564 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:52.527529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:54.342198 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:54.342156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:54.439859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:54.439818 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:54.496742 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:54.496697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:54.669188 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:54.669102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:54.722143 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:54.722109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:58.485275 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:58.485241 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:28:58.485800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:58.485307 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:28:58.863230 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:58.863130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:28:59.787637 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:28:59.787588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:00.173014 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:00.172926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:00.221266 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:00.221240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:01.976316 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:01.976279 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:07.465425 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:07.465394 2579 generic.go:356] "Generic (PLEG): container finished" podID="6cec6ea4-724b-4e32-929c-d6cc0e169cf9" containerID="85d68ffa23ae11c3d56369c8de93838251a48417d1a881f7c85d576f20c29eb7" exitCode=0 Jun 05 13:29:07.465425 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:07.465427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" event={"ID":"6cec6ea4-724b-4e32-929c-d6cc0e169cf9","Type":"ContainerDied","Data":"85d68ffa23ae11c3d56369c8de93838251a48417d1a881f7c85d576f20c29eb7"} Jun 05 13:29:07.465816 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:07.465684 2579 scope.go:117] "RemoveContainer" containerID="85d68ffa23ae11c3d56369c8de93838251a48417d1a881f7c85d576f20c29eb7" Jun 05 13:29:08.469993 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:08.469961 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fsn99" event={"ID":"6cec6ea4-724b-4e32-929c-d6cc0e169cf9","Type":"ContainerStarted","Data":"51c75b440302d7d36d9a1322c974665a8f1cfacf49945894c627a8e4c8d25a6f"} Jun 05 13:29:08.485408 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:08.485377 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:08.485542 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:08.485425 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:08.872640 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:08.872559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:08.973753 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:08.973717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:10.270574 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:10.270536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:10.374702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:10.374672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:11.069054 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:11.069017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:11.133752 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:11.133716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:13.499642 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:13.499606 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" containerID="cri-o://c1e094abcba586b702bc215d9636931320921bdcf68310a2139a518dc16f6118" gracePeriod=30 Jun 05 13:29:14.489984 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:14.489956 2579 generic.go:356] "Generic (PLEG): container finished" podID="2491609e-3caa-488a-b470-c1557a54814a" containerID="c1e094abcba586b702bc215d9636931320921bdcf68310a2139a518dc16f6118" exitCode=0 Jun 05 13:29:14.490199 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:14.490036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerDied","Data":"c1e094abcba586b702bc215d9636931320921bdcf68310a2139a518dc16f6118"} Jun 05 13:29:14.490199 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:14.490080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerStarted","Data":"17aba4fde193f506479271db9fe8d10b343e5e3e2845a05a74321d693bdada49"} Jun 05 13:29:14.490330 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:14.490254 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:29:18.343774 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:18.343724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:18.421882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:18.421845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:19.917805 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:19.917767 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-6mrtd_95d67839-6a9b-4de4-82e3-4ed07fa42ff2/networking-console-plugin/0.log" Jun 05 13:29:21.541670 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:21.541638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:29:21.543984 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:21.543960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49a453a5-c753-4d32-95bb-2d5bd4e44e13-metrics-certs\") pod \"network-metrics-daemon-pkp4h\" (UID: \"49a453a5-c753-4d32-95bb-2d5bd4e44e13\") " pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:29:21.718636 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:21.718607 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dnbr4\"" Jun 05 13:29:21.726596 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:21.726580 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkp4h" Jun 05 13:29:21.847675 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:21.847645 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkp4h"] Jun 05 13:29:21.850582 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:29:21.850558 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a453a5_c753_4d32_95bb_2d5bd4e44e13.slice/crio-8e869fb9b0514a87f2a25964dca9c22df7371b194df91e81d6eb64d8640835c1 WatchSource:0}: Error finding container 8e869fb9b0514a87f2a25964dca9c22df7371b194df91e81d6eb64d8640835c1: Status 404 returned error can't find the container with id 8e869fb9b0514a87f2a25964dca9c22df7371b194df91e81d6eb64d8640835c1 Jun 05 13:29:21.917376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:21.917355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4f4r_a04c5bdb-957a-4fd2-b97a-d462c80c807f/dns-node-resolver/0.log" Jun 05 13:29:22.517014 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:22.516971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkp4h" event={"ID":"49a453a5-c753-4d32-95bb-2d5bd4e44e13","Type":"ContainerStarted","Data":"8e869fb9b0514a87f2a25964dca9c22df7371b194df91e81d6eb64d8640835c1"} Jun 05 13:29:22.518400 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:22.518375 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7ddbbd677-p75gm_2491609e-3caa-488a-b470-c1557a54814a/registry/0.log" Jun 05 13:29:22.717828 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:22.717804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7ddbbd677-p75gm_2491609e-3caa-488a-b470-c1557a54814a/registry/1.log" Jun 05 13:29:22.917685 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:22.917650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxpq6_6748f1dc-bb7c-4921-9543-fbc7b0c0f508/node-ca/0.log" Jun 05 13:29:23.517732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:23.517698 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffdd48847-ld2hm_958b617c-e62e-4ae8-9789-3eebd8b71fe8/router/0.log" Jun 05 13:29:23.521398 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:23.521372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkp4h" event={"ID":"49a453a5-c753-4d32-95bb-2d5bd4e44e13","Type":"ContainerStarted","Data":"9f7d67769836e00994030c9b9e3366e9857776788ed7e0c80ef541f0fb8098d5"} Jun 05 13:29:23.521506 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:23.521424 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkp4h" event={"ID":"49a453a5-c753-4d32-95bb-2d5bd4e44e13","Type":"ContainerStarted","Data":"5c198a79f0b2cd114b5cce1fe9479b8312196294eff30da46940b9e3ca96380f"} Jun 05 13:29:23.537228 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:23.537175 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pkp4h" podStartSLOduration=258.702610675 podStartE2EDuration="4m19.537161276s" totalImagesPullingTime="834.550601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:29:23.536687321 +0000 UTC m=+272.351636978" watchObservedRunningTime="2026-06-05 13:29:23.537161276 +0000 UTC m=+272.352110930" Jun 05 13:29:23.917868 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:23.917783 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf82x_cd513d02-8a9b-45fb-8291-a243be7fab29/serve-healthcheck-canary/0.log" Jun 05 13:29:26.531849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:26.531813 2579 generic.go:356] "Generic (PLEG): container finished" podID="8768f77c-60c1-4dbb-ae8c-e1d4a77bd316" containerID="686aa093b375038d24ed6497f05e0b2dc5edf5b238d9327f7aa35000d22bfcc3" exitCode=0 Jun 05 13:29:26.532211 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:26.531884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" event={"ID":"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316","Type":"ContainerDied","Data":"686aa093b375038d24ed6497f05e0b2dc5edf5b238d9327f7aa35000d22bfcc3"} Jun 05 13:29:26.532211 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:26.532194 2579 scope.go:117] "RemoveContainer" containerID="686aa093b375038d24ed6497f05e0b2dc5edf5b238d9327f7aa35000d22bfcc3" Jun 05 13:29:27.071922 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:27.071887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:27.536936 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:27.536904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vfhgw" event={"ID":"8768f77c-60c1-4dbb-ae8c-e1d4a77bd316","Type":"ContainerStarted","Data":"3ec38aeed04982c683e6a5e266344585fd4862c98ae655464f4950e3254c00f1"} Jun 05 13:29:27.978326 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:27.978283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:28.482192 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:28.482159 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:28.482364 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:28.482208 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:35.497383 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:35.497349 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:35.497821 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:35.497397 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:36.501344 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:36.501291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:36.585169 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:36.585131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:37.490885 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:37.490829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:38.481362 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:38.481329 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:38.481796 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:38.481383 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:45.497638 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:45.497604 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:45.497997 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:45.497658 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:47.032937 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:47.032887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:47.088706 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:47.088666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:48.480962 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:48.480924 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:48.481408 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:48.480983 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:48.481408 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:48.481020 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:29:48.481504 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:48.481453 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"17aba4fde193f506479271db9fe8d10b343e5e3e2845a05a74321d693bdada49"} pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:29:48.484892 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:48.484867 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:48.485011 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:48.484910 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:50.189830 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:29:50.189790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kplxt" podUID="885c3cde-1614-4114-a516-cdff6c5b5966" Jun 05 13:29:50.614674 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:50.614582 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kplxt" Jun 05 13:29:51.561666 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:51.561629 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:29:51.563440 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:51.563418 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 13:29:51.564120 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:51.564102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:29:51.850499 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:51.850416 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:51.900426 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:51.900394 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:52.524151 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:52.524116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:52.625143 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:52.625111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:53.460566 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:53.460525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:29:53.462865 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:53.462837 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/885c3cde-1614-4114-a516-cdff6c5b5966-metrics-tls\") pod \"dns-default-kplxt\" (UID: \"885c3cde-1614-4114-a516-cdff6c5b5966\") " pod="openshift-dns/dns-default-kplxt" Jun 05 13:29:53.617732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:53.617703 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cwhcz\"" Jun 05 13:29:53.625672 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:53.625650 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kplxt" Jun 05 13:29:53.751033 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:53.751002 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kplxt"] Jun 05 13:29:53.753375 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:29:53.753351 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885c3cde_1614_4114_a516_cdff6c5b5966.slice/crio-3602c1ead4fe522c79b561c6d94cc5ea7de527a05d711782dfa4bcf1edaf6b23 WatchSource:0}: Error finding container 3602c1ead4fe522c79b561c6d94cc5ea7de527a05d711782dfa4bcf1edaf6b23: Status 404 returned error can't find the container with id 3602c1ead4fe522c79b561c6d94cc5ea7de527a05d711782dfa4bcf1edaf6b23 Jun 05 13:29:53.755382 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:53.755363 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:29:54.629043 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:54.629002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kplxt" event={"ID":"885c3cde-1614-4114-a516-cdff6c5b5966","Type":"ContainerStarted","Data":"3602c1ead4fe522c79b561c6d94cc5ea7de527a05d711782dfa4bcf1edaf6b23"} Jun 05 13:29:55.633945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:55.633863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kplxt" event={"ID":"885c3cde-1614-4114-a516-cdff6c5b5966","Type":"ContainerStarted","Data":"6a549b4372dd1be1a9a18141e58a4b1650dd70f20f9ed59be94a1f8ba5609492"} Jun 05 13:29:55.633945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:55.633915 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kplxt" event={"ID":"885c3cde-1614-4114-a516-cdff6c5b5966","Type":"ContainerStarted","Data":"3605b83fb0587524ac77b089c8e9b12a3bd96a03b4baa937e78e0b56ed70c21d"} Jun 05 13:29:55.634360 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:55.634019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kplxt" Jun 05 13:29:55.653153 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:55.653105 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kplxt" podStartSLOduration=251.099288272 podStartE2EDuration="4m12.653088365s" totalImagesPullingTime="1.553800093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:29:55.652492697 +0000 UTC m=+304.467442354" watchObservedRunningTime="2026-06-05 13:29:55.653088365 +0000 UTC m=+304.468038020" Jun 05 13:29:56.633599 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:56.633563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:56.689551 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:56.689515 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:58.485634 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:58.485604 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:58.486003 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:58.485652 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:59.799653 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:59.799614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:29:59.861374 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:29:59.861347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:00.215862 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:00.215831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:00.267056 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:00.267024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:05.641059 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:05.641033 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kplxt" Jun 05 13:30:06.169550 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:06.169512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:06.242931 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:06.242887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:08.485351 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:08.485311 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:08.485800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:08.485370 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:13.499765 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:13.499712 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" containerID="cri-o://17aba4fde193f506479271db9fe8d10b343e5e3e2845a05a74321d693bdada49" gracePeriod=30 Jun 05 13:30:13.695167 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:13.695134 2579 generic.go:356] "Generic (PLEG): container finished" podID="2491609e-3caa-488a-b470-c1557a54814a" containerID="17aba4fde193f506479271db9fe8d10b343e5e3e2845a05a74321d693bdada49" exitCode=0 Jun 05 13:30:13.695313 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:13.695196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerDied","Data":"17aba4fde193f506479271db9fe8d10b343e5e3e2845a05a74321d693bdada49"} Jun 05 13:30:13.695313 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:13.695260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerStarted","Data":"b12daa6d7589d947725f470a8cf2dc98f75eac54aa918b2ac6d21342a415ab6b"} Jun 05 13:30:13.695313 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:13.695281 2579 scope.go:117] "RemoveContainer" containerID="c1e094abcba586b702bc215d9636931320921bdcf68310a2139a518dc16f6118" Jun 05 13:30:13.695477 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:13.695413 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:30:15.690946 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:15.690908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:15.746544 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:15.746508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:25.166336 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:25.166300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:25.213584 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:25.213545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:28.480747 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:28.480710 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:28.481110 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:28.480773 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:34.704551 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:34.704475 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:34.704551 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:34.704526 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:34.747977 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:34.747945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:38.481676 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:38.481638 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:38.482053 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:38.481693 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:38.793337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:38.793212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:38.847090 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:38.847063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:42.386026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:42.385988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:42.440960 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:42.440929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:44.378148 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:44.378118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:44.704955 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:44.704919 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:44.705106 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:44.704989 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:48.480771 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:48.480736 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:48.481181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:48.480798 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:48.481181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:48.480836 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:30:48.481287 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:48.481256 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"b12daa6d7589d947725f470a8cf2dc98f75eac54aa918b2ac6d21342a415ab6b"} pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:30:48.484853 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:48.484828 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:48.484996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:48.484865 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:52.563960 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:52.563926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:52.618770 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:52.618733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:52.872331 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:52.872244 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:52.942818 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:52.942784 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:53.221998 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:53.221956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:53.977966 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:53.977932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:54.033748 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:54.033720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:58.485972 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:58.485937 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:58.486383 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:58.485997 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:59.819804 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:59.819766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:30:59.871301 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:30:59.871265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:00.255335 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:00.255303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:00.308017 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:00.307987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:03.653234 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:03.653187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:03.708056 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:03.708021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:04.319849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:04.319813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:04.422963 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:04.422929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:08.485791 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:08.485758 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:08.486161 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:08.485812 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:11.509631 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:11.509591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:11.609372 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:11.609336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:13.142522 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.142485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:13.499884 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.499848 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" containerID="cri-o://b12daa6d7589d947725f470a8cf2dc98f75eac54aa918b2ac6d21342a415ab6b" gracePeriod=30 Jun 05 13:31:13.902909 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.902826 2579 generic.go:356] "Generic (PLEG): container finished" podID="2491609e-3caa-488a-b470-c1557a54814a" containerID="b12daa6d7589d947725f470a8cf2dc98f75eac54aa918b2ac6d21342a415ab6b" exitCode=0 Jun 05 13:31:13.902909 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.902891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerDied","Data":"b12daa6d7589d947725f470a8cf2dc98f75eac54aa918b2ac6d21342a415ab6b"} Jun 05 13:31:13.903125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.902941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerStarted","Data":"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55"} Jun 05 13:31:13.903125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.902969 2579 scope.go:117] "RemoveContainer" containerID="17aba4fde193f506479271db9fe8d10b343e5e3e2845a05a74321d693bdada49" Jun 05 13:31:13.903125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:13.903117 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:31:16.505016 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:16.504983 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:16.561883 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:16.561853 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:18.142889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:18.142856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:18.243466 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:18.243432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:21.490158 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:21.490121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:21.567557 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:21.567519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:22.650946 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:22.650904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:22.703529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:22.703497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:26.122770 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:26.122740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:26.222983 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:26.222932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:26.324358 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:26.324322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:26.445360 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:26.445330 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:26.593320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:26.593278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:27.107081 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:27.107026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:28.481199 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:28.481166 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:28.481585 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:28.481240 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:29.087576 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:29.087543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:29.190128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:29.190088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:31.542589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:31.542557 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:31.687363 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:31.687333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:31.831970 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:31.831884 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:32.241232 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:32.241194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:32.340835 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:32.340775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:34.912821 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:34.912788 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:34.913186 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:34.912836 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:36.127796 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:36.127747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:36.518970 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:36.518941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:36.596445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:36.596408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:36.809665 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:36.809583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:38.480148 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:38.480115 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:38.480530 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:38.480178 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:38.853654 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:38.853574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:38.969426 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:38.969375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:39.024312 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:39.024276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:41.938547 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:41.938518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:42.039846 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:42.039804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:44.913051 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:44.913016 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:44.913432 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:44.913068 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:48.480911 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:48.480872 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:48.481288 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:48.480942 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:48.481288 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:48.480987 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:31:48.481505 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:48.481487 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55"} pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:31:48.485126 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:48.485101 2579 patch_prober.go:28] interesting pod/image-registry-7ddbbd677-p75gm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:48.485258 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:48.485148 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:50.551497 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.551463 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:50.661326 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.661292 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:50.712435 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.712401 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ddbbd677-p75gm"] Jun 05 13:31:50.760464 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.760432 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-8pnvg"] Jun 05 13:31:50.763752 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.763730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:31:50.764811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.764788 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx"] Jun 05 13:31:50.767560 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.767542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:50.769511 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.769488 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 13:31:50.769683 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.769661 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v2r77\"" Jun 05 13:31:50.770285 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.770268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 13:31:50.771705 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.771686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 13:31:50.772578 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.772558 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s4k2l\"" Jun 05 13:31:50.788264 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.788239 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8pnvg"] Jun 05 13:31:50.790521 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.790498 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lmm9v"] Jun 05 13:31:50.793976 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.793956 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx"] Jun 05 13:31:50.794080 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.794067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:50.796627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.796605 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 13:31:50.796919 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.796897 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 13:31:50.797021 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.796920 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 13:31:50.797021 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.796983 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 13:31:50.797193 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.797065 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dm24g\"" Jun 05 13:31:50.807943 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.807891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lmm9v"] Jun 05 13:31:50.821359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.821329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:50.844106 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.844080 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bd95566f8-vlczq"] Jun 05 13:31:50.846963 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.846945 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.883155 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.883128 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd95566f8-vlczq"] Jun 05 13:31:50.940453 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d302655-f35b-44b9-a0ba-64c1590b5040-image-registry-private-configuration\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d302655-f35b-44b9-a0ba-64c1590b5040-trusted-ca\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/413b40e8-afad-4160-ac59-264f100113cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:50.940580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d302655-f35b-44b9-a0ba-64c1590b5040-installation-pull-secrets\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/413b40e8-afad-4160-ac59-264f100113cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:50.940580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-bound-sa-token\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8l2\" (UniqueName: \"kubernetes.io/projected/0f34352f-a9f4-4af7-9fad-f6c4677d7581-kube-api-access-hk8l2\") pod \"downloads-6657875f97-8pnvg\" (UID: \"0f34352f-a9f4-4af7-9fad-f6c4677d7581\") " pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh5cp\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-kube-api-access-nh5cp\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/413b40e8-afad-4160-ac59-264f100113cb-data-volume\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d302655-f35b-44b9-a0ba-64c1590b5040-registry-certificates\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-registry-tls\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crghs\" (UniqueName: \"kubernetes.io/projected/413b40e8-afad-4160-ac59-264f100113cb-kube-api-access-crghs\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:50.940781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/413b40e8-afad-4160-ac59-264f100113cb-crio-socket\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:50.941026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3427df1c-db47-46f3-b623-31d426ec1bb0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t7tnx\" (UID: \"3427df1c-db47-46f3-b623-31d426ec1bb0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:50.941026 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.940825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d302655-f35b-44b9-a0ba-64c1590b5040-ca-trust-extracted\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:50.977295 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:50.977274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:51.041502 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh5cp\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-kube-api-access-nh5cp\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.041588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/413b40e8-afad-4160-ac59-264f100113cb-data-volume\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.041588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d302655-f35b-44b9-a0ba-64c1590b5040-registry-certificates\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.041588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-registry-tls\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.041588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crghs\" (UniqueName: \"kubernetes.io/projected/413b40e8-afad-4160-ac59-264f100113cb-kube-api-access-crghs\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/413b40e8-afad-4160-ac59-264f100113cb-crio-socket\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3427df1c-db47-46f3-b623-31d426ec1bb0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t7tnx\" (UID: \"3427df1c-db47-46f3-b623-31d426ec1bb0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d302655-f35b-44b9-a0ba-64c1590b5040-ca-trust-extracted\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d302655-f35b-44b9-a0ba-64c1590b5040-image-registry-private-configuration\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d302655-f35b-44b9-a0ba-64c1590b5040-trusted-ca\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/413b40e8-afad-4160-ac59-264f100113cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.041764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.041705 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/413b40e8-afad-4160-ac59-264f100113cb-crio-socket\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.042092 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d302655-f35b-44b9-a0ba-64c1590b5040-ca-trust-extracted\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.042092 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042038 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/413b40e8-afad-4160-ac59-264f100113cb-data-volume\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.042092 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d302655-f35b-44b9-a0ba-64c1590b5040-installation-pull-secrets\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.042286 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/413b40e8-afad-4160-ac59-264f100113cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.042286 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-bound-sa-token\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.042286 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8l2\" (UniqueName: \"kubernetes.io/projected/0f34352f-a9f4-4af7-9fad-f6c4677d7581-kube-api-access-hk8l2\") pod \"downloads-6657875f97-8pnvg\" (UID: \"0f34352f-a9f4-4af7-9fad-f6c4677d7581\") " pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:31:51.042286 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/413b40e8-afad-4160-ac59-264f100113cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.042482 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.042414 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d302655-f35b-44b9-a0ba-64c1590b5040-registry-certificates\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.043189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.043159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d302655-f35b-44b9-a0ba-64c1590b5040-trusted-ca\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.044514 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.044495 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d302655-f35b-44b9-a0ba-64c1590b5040-image-registry-private-configuration\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.044592 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.044528 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d302655-f35b-44b9-a0ba-64c1590b5040-installation-pull-secrets\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.044664 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.044644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3427df1c-db47-46f3-b623-31d426ec1bb0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t7tnx\" (UID: \"3427df1c-db47-46f3-b623-31d426ec1bb0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:51.045042 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.045026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-registry-tls\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.045094 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.045041 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/413b40e8-afad-4160-ac59-264f100113cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.052295 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.052265 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-bound-sa-token\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.052918 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.052896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8l2\" (UniqueName: \"kubernetes.io/projected/0f34352f-a9f4-4af7-9fad-f6c4677d7581-kube-api-access-hk8l2\") pod \"downloads-6657875f97-8pnvg\" (UID: \"0f34352f-a9f4-4af7-9fad-f6c4677d7581\") " pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:31:51.053100 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.053075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh5cp\" (UniqueName: \"kubernetes.io/projected/1d302655-f35b-44b9-a0ba-64c1590b5040-kube-api-access-nh5cp\") pod \"image-registry-5bd95566f8-vlczq\" (UID: \"1d302655-f35b-44b9-a0ba-64c1590b5040\") " pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.053272 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.053244 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crghs\" (UniqueName: \"kubernetes.io/projected/413b40e8-afad-4160-ac59-264f100113cb-kube-api-access-crghs\") pod \"insights-runtime-extractor-lmm9v\" (UID: \"413b40e8-afad-4160-ac59-264f100113cb\") " pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.069112 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.069052 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:51.074986 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.074958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:31:51.079905 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.079890 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:51.103557 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.103512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lmm9v" Jun 05 13:31:51.155355 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.155283 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:51.175255 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.175199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:51.233124 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.233094 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8pnvg"] Jun 05 13:31:51.238541 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:31:51.238500 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f34352f_a9f4_4af7_9fad_f6c4677d7581.slice/crio-f8995ab61b6af5fab0fd54ba6699095d9c1965fe481fd190d0b9b463c5ba4563 WatchSource:0}: Error finding container f8995ab61b6af5fab0fd54ba6699095d9c1965fe481fd190d0b9b463c5ba4563: Status 404 returned error can't find the container with id f8995ab61b6af5fab0fd54ba6699095d9c1965fe481fd190d0b9b463c5ba4563 Jun 05 13:31:51.253582 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.253561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx"] Jun 05 13:31:51.256737 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:31:51.256712 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3427df1c_db47_46f3_b623_31d426ec1bb0.slice/crio-11641d5b87f00ba2aa8b8318f29b5e55880c73661898c794d35a5494fe9cc259 WatchSource:0}: Error finding container 11641d5b87f00ba2aa8b8318f29b5e55880c73661898c794d35a5494fe9cc259: Status 404 returned error can't find the container with id 11641d5b87f00ba2aa8b8318f29b5e55880c73661898c794d35a5494fe9cc259 Jun 05 13:31:51.279289 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.279266 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lmm9v"] Jun 05 13:31:51.282342 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:31:51.282322 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413b40e8_afad_4160_ac59_264f100113cb.slice/crio-f48160d2ac31f58304bf4415be03cc00f252d247071296baf3dca00410f5ca1d WatchSource:0}: Error finding container f48160d2ac31f58304bf4415be03cc00f252d247071296baf3dca00410f5ca1d: Status 404 returned error can't find the container with id f48160d2ac31f58304bf4415be03cc00f252d247071296baf3dca00410f5ca1d Jun 05 13:31:51.309359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.309335 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bd95566f8-vlczq"] Jun 05 13:31:51.314233 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:31:51.314194 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d302655_f35b_44b9_a0ba_64c1590b5040.slice/crio-3af4e547d4cf0261c331361d1a130f3b89afe4fe03566935e64e43be4a10c2a0 WatchSource:0}: Error finding container 3af4e547d4cf0261c331361d1a130f3b89afe4fe03566935e64e43be4a10c2a0: Status 404 returned error can't find the container with id 3af4e547d4cf0261c331361d1a130f3b89afe4fe03566935e64e43be4a10c2a0 Jun 05 13:31:51.638411 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.638322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:51.696519 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:51.696471 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:52.030184 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.030145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8pnvg" event={"ID":"0f34352f-a9f4-4af7-9fad-f6c4677d7581","Type":"ContainerStarted","Data":"f8995ab61b6af5fab0fd54ba6699095d9c1965fe481fd190d0b9b463c5ba4563"} Jun 05 13:31:52.031937 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.031910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" event={"ID":"1d302655-f35b-44b9-a0ba-64c1590b5040","Type":"ContainerStarted","Data":"e0e007a13fb84807215b3d41ba0df95970dab7f3d7541ba5006e459f24c067d5"} Jun 05 13:31:52.032066 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.031955 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" event={"ID":"1d302655-f35b-44b9-a0ba-64c1590b5040","Type":"ContainerStarted","Data":"3af4e547d4cf0261c331361d1a130f3b89afe4fe03566935e64e43be4a10c2a0"} Jun 05 13:31:52.032066 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.032031 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:31:52.034362 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.034338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmm9v" event={"ID":"413b40e8-afad-4160-ac59-264f100113cb","Type":"ContainerStarted","Data":"d8b929d13acb5d103826eb019af39b6fa5923313746555eea8cf31330b39cbba"} Jun 05 13:31:52.034484 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.034390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmm9v" event={"ID":"413b40e8-afad-4160-ac59-264f100113cb","Type":"ContainerStarted","Data":"7d240dfddd5e15c31bf0e2ca64082407327793530a5eada1b834eb1392f7c955"} Jun 05 13:31:52.034484 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.034420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmm9v" event={"ID":"413b40e8-afad-4160-ac59-264f100113cb","Type":"ContainerStarted","Data":"f48160d2ac31f58304bf4415be03cc00f252d247071296baf3dca00410f5ca1d"} Jun 05 13:31:52.036046 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.036023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" event={"ID":"3427df1c-db47-46f3-b623-31d426ec1bb0","Type":"ContainerStarted","Data":"11641d5b87f00ba2aa8b8318f29b5e55880c73661898c794d35a5494fe9cc259"} Jun 05 13:31:52.052427 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:52.052376 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" podStartSLOduration=2.052353315 podStartE2EDuration="2.052353315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:31:52.051752817 +0000 UTC m=+420.866702475" watchObservedRunningTime="2026-06-05 13:31:52.052353315 +0000 UTC m=+420.867302972" Jun 05 13:31:53.043187 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:53.043148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" event={"ID":"3427df1c-db47-46f3-b623-31d426ec1bb0","Type":"ContainerStarted","Data":"37b0582fcc6c11a4b212c837299ef4cc0c969177b26cb8e0f92ad363311a7fa1"} Jun 05 13:31:53.043930 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:53.043466 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:53.049476 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:53.049446 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" Jun 05 13:31:53.077090 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:53.077042 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7tnx" podStartSLOduration=1.987063247 podStartE2EDuration="3.077023985s" totalImagesPullingTime="1.089960738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:31:53.059199784 +0000 UTC m=+421.874149443" watchObservedRunningTime="2026-06-05 13:31:53.077023985 +0000 UTC m=+421.891973642" Jun 05 13:31:53.847385 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:53.847291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:53.920012 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:53.919976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:54.048488 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:54.048428 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:54.050180 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:54.050134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmm9v" event={"ID":"413b40e8-afad-4160-ac59-264f100113cb","Type":"ContainerStarted","Data":"3df30a9df2d0886dde5d73fe95ce40113b6fd831ac60d2cfee6e9baf5af9d284"} Jun 05 13:31:54.072383 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:54.072332 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lmm9v" podStartSLOduration=2.010195922 podStartE2EDuration="4.072313929s" totalImagesPullingTime="2.062118007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:31:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:31:54.070687898 +0000 UTC m=+422.885637556" watchObservedRunningTime="2026-06-05 13:31:54.072313929 +0000 UTC m=+422.887263786" Jun 05 13:31:55.994973 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:55.994932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:56.475442 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:56.475378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:56.555613 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:56.555570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:57.992660 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:57.992629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.211714 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.211668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.281763 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.281685 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ggljg"] Jun 05 13:31:58.292018 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.291990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.295024 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.294999 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 13:31:58.295024 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.294999 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 13:31:58.295257 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.295066 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 13:31:58.295257 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.295095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 13:31:58.295257 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.295118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 13:31:58.295257 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.295204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 13:31:58.296296 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.296273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-87gv9\"" Jun 05 13:31:58.301874 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.301842 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.365898 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.365862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.405870 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.405840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-root\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.405880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-sys\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.405907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.405930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-textfile\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.405964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj5vn\" (UniqueName: \"kubernetes.io/projected/940947b4-bbf4-49b2-8568-291a79336f6d-kube-api-access-sj5vn\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406236 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.406008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-tls\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406236 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.406026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-wtmp\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406236 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.406048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/940947b4-bbf4-49b2-8568-291a79336f6d-metrics-client-ca\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.406236 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.406110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.429517 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.429485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.486863 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.486842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:31:58.507403 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507518 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-root\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507518 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-sys\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507518 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507518 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-textfile\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj5vn\" (UniqueName: \"kubernetes.io/projected/940947b4-bbf4-49b2-8568-291a79336f6d-kube-api-access-sj5vn\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-tls\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-sys\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-wtmp\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-root\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-wtmp\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.507744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/940947b4-bbf4-49b2-8568-291a79336f6d-metrics-client-ca\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.508099 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:31:58.507751 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 13:31:58.508099 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:31:58.507820 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-tls podName:940947b4-bbf4-49b2-8568-291a79336f6d nodeName:}" failed. No retries permitted until 2026-06-05 13:31:59.007801942 +0000 UTC m=+427.822751581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-tls") pod "node-exporter-ggljg" (UID: "940947b4-bbf4-49b2-8568-291a79336f6d") : secret "node-exporter-tls" not found Jun 05 13:31:58.508099 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.507948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-textfile\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.508099 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.508083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.508361 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.508340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/940947b4-bbf4-49b2-8568-291a79336f6d-metrics-client-ca\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.510374 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.510180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.515896 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.515873 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj5vn\" (UniqueName: \"kubernetes.io/projected/940947b4-bbf4-49b2-8568-291a79336f6d-kube-api-access-sj5vn\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:58.587581 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.587487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.685812 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.685783 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.747780 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.747734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:58.848131 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:58.848051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:59.012579 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.012536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-tls\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:59.015291 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.015268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/940947b4-bbf4-49b2-8568-291a79336f6d-node-exporter-tls\") pod \"node-exporter-ggljg\" (UID: \"940947b4-bbf4-49b2-8568-291a79336f6d\") " pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:59.029409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.029375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:59.203807 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.203775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggljg" Jun 05 13:31:59.218287 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.218259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:59.218588 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:31:59.218548 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940947b4_bbf4_49b2_8568_291a79336f6d.slice/crio-5f873246085da85eff38550d9273025e1da5e04ea6d2a5dd7fb33f48e2b15808 WatchSource:0}: Error finding container 5f873246085da85eff38550d9273025e1da5e04ea6d2a5dd7fb33f48e2b15808: Status 404 returned error can't find the container with id 5f873246085da85eff38550d9273025e1da5e04ea6d2a5dd7fb33f48e2b15808 Jun 05 13:31:59.302915 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.302875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:31:59.418796 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:31:59.418762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:00.073886 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:00.073856 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggljg" event={"ID":"940947b4-bbf4-49b2-8568-291a79336f6d","Type":"ContainerStarted","Data":"5f873246085da85eff38550d9273025e1da5e04ea6d2a5dd7fb33f48e2b15808"} Jun 05 13:32:01.079896 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:01.079863 2579 generic.go:356] "Generic (PLEG): container finished" podID="940947b4-bbf4-49b2-8568-291a79336f6d" containerID="43f487826ccb9f26b0001bb42486fc361fc12326c96eb9098820737c416ed346" exitCode=0 Jun 05 13:32:01.080428 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:01.079960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggljg" event={"ID":"940947b4-bbf4-49b2-8568-291a79336f6d","Type":"ContainerDied","Data":"43f487826ccb9f26b0001bb42486fc361fc12326c96eb9098820737c416ed346"} Jun 05 13:32:01.208178 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:01.208140 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:01.278869 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:01.278826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:01.575880 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:01.575844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:01.665625 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:01.665568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:02.086237 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.086178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggljg" event={"ID":"940947b4-bbf4-49b2-8568-291a79336f6d","Type":"ContainerStarted","Data":"7898718b8209bd2ccb56f75438bebc4ad5088bfebce6e6618741861c02a944fb"} Jun 05 13:32:02.086644 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.086259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggljg" event={"ID":"940947b4-bbf4-49b2-8568-291a79336f6d","Type":"ContainerStarted","Data":"342dc374d4fba70dbacfd9acd2565a0cc4135f3727feea2a19aa0ef3d7473551"} Jun 05 13:32:02.107105 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.107061 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ggljg" podStartSLOduration=3.172774075 podStartE2EDuration="4.107045697s" totalImagesPullingTime="859.141621ms" totalInitContainerRuntime="75.130001ms" isStatefulPod=true podCreationTimestamp="2026-06-05 13:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:02.105679352 +0000 UTC m=+430.920629007" watchObservedRunningTime="2026-06-05 13:32:02.107045697 +0000 UTC m=+430.921995394" Jun 05 13:32:02.136129 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.136090 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:02.236314 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.236274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:02.686558 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.686522 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f8cf447dc-vglbz"] Jun 05 13:32:02.690770 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.690744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.693550 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.693515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 05 13:32:02.693684 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.693662 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9148rgp9koafa\"" Jun 05 13:32:02.693836 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.693676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gr7ww\"" Jun 05 13:32:02.694715 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.694693 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 05 13:32:02.694828 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.694743 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 13:32:02.694828 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.694746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 05 13:32:02.700735 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.700713 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f8cf447dc-vglbz"] Jun 05 13:32:02.740064 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.740205 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-metrics-server-audit-profiles\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.740205 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-secret-metrics-server-client-certs\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.740205 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndtjh\" (UniqueName: \"kubernetes.io/projected/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-kube-api-access-ndtjh\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.740392 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-client-ca-bundle\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.740392 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-audit-log\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.740392 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.740338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-secret-metrics-server-tls\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841094 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndtjh\" (UniqueName: \"kubernetes.io/projected/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-kube-api-access-ndtjh\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841094 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-client-ca-bundle\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841390 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-audit-log\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841390 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-secret-metrics-server-tls\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841390 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841390 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-metrics-server-audit-profiles\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841603 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-secret-metrics-server-client-certs\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.841603 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.841574 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-audit-log\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.842126 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.842076 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.842594 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.842568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-metrics-server-audit-profiles\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.844143 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.844124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-secret-metrics-server-tls\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.844745 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.844723 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-client-ca-bundle\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.844850 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.844770 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-secret-metrics-server-client-certs\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:02.849273 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:02.849254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndtjh\" (UniqueName: \"kubernetes.io/projected/e1dc3827-1e5c-4261-bd33-a7fa3535fc39-kube-api-access-ndtjh\") pod \"metrics-server-f8cf447dc-vglbz\" (UID: \"e1dc3827-1e5c-4261-bd33-a7fa3535fc39\") " pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:03.002900 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:03.002773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:03.031623 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:03.031582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:03.093434 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:03.093386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:03.385312 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:03.385208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:03.458679 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:03.458631 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:04.006189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.006158 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-764c59b6fc-z8nts"] Jun 05 13:32:04.009593 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.009567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.012190 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.012164 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 13:32:04.013520 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.013364 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 13:32:04.013520 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.013431 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 13:32:04.013520 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.013457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lsw9b\"" Jun 05 13:32:04.013520 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.013429 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 13:32:04.013882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.013864 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 13:32:04.017853 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.017829 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 13:32:04.022400 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.022380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764c59b6fc-z8nts"] Jun 05 13:32:04.050630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-service-ca\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.050630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-trusted-ca-bundle\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.050843 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-oauth-serving-cert\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.050843 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-serving-cert\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.050843 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-oauth-config\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.051008 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-config\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.051008 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.050907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6xp\" (UniqueName: \"kubernetes.io/projected/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-kube-api-access-5m6xp\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.152280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-serving-cert\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.152767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-oauth-config\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.152767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-config\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.152767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6xp\" (UniqueName: \"kubernetes.io/projected/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-kube-api-access-5m6xp\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.152767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-service-ca\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.153008 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-trusted-ca-bundle\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.153008 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.152823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-oauth-serving-cert\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.153213 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.153165 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-config\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.153523 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.153470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-service-ca\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.153627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.153571 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-oauth-serving-cert\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.153722 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.153645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-trusted-ca-bundle\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.155392 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.155370 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-serving-cert\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.155578 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.155551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-oauth-config\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.160368 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.160349 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6xp\" (UniqueName: \"kubernetes.io/projected/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-kube-api-access-5m6xp\") pod \"console-764c59b6fc-z8nts\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.322956 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.322864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:04.344020 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.343982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:04.444055 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.444018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:04.558225 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:04.558187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:07.627088 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.627052 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764c59b6fc-z8nts"] Jun 05 13:32:07.654247 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.654207 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56c589444f-lnpq8"] Jun 05 13:32:07.660104 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.660085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.666740 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.666718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c589444f-lnpq8"] Jun 05 13:32:07.683734 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683691 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-serving-cert\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.683846 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkk57\" (UniqueName: \"kubernetes.io/projected/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-kube-api-access-qkk57\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.683846 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-service-ca\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.683846 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-oauth-serving-cert\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.683996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-config\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.683996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-trusted-ca-bundle\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.683996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.683985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-oauth-config\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.784943 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.784908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-trusted-ca-bundle\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.784969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-oauth-config\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-serving-cert\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkk57\" (UniqueName: \"kubernetes.io/projected/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-kube-api-access-qkk57\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-service-ca\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785369 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-oauth-serving-cert\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785419 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-config\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.785942 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-service-ca\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.786074 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.785963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-trusted-ca-bundle\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.786074 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.786006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-oauth-serving-cert\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.786074 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.786028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-config\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.787770 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.787742 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-serving-cert\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.787770 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.787757 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-oauth-config\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.792423 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.792401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkk57\" (UniqueName: \"kubernetes.io/projected/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-kube-api-access-qkk57\") pod \"console-56c589444f-lnpq8\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:07.972394 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:07.972357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:08.064149 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:08.064113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:08.624856 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:08.624748 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:08.668364 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:08.668335 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764c59b6fc-z8nts"] Jun 05 13:32:08.672169 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:32:08.672143 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea3cab1_0c53_40e4_ae9d_e90ba7af73bd.slice/crio-2b665cafe3236d0f4949cb7e40ebf12e2dc9367215815659a5284365bf614b34 WatchSource:0}: Error finding container 2b665cafe3236d0f4949cb7e40ebf12e2dc9367215815659a5284365bf614b34: Status 404 returned error can't find the container with id 2b665cafe3236d0f4949cb7e40ebf12e2dc9367215815659a5284365bf614b34 Jun 05 13:32:08.675488 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:08.675268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:08.685505 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:08.685466 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c589444f-lnpq8"] Jun 05 13:32:08.688061 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:32:08.688034 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f59628_f5f3_4dcd_b75a_ca78b2558dc0.slice/crio-ff523731ddb1df95177869b3150c79ac54a80737a16abe4662ea6849f084319b WatchSource:0}: Error finding container ff523731ddb1df95177869b3150c79ac54a80737a16abe4662ea6849f084319b: Status 404 returned error can't find the container with id ff523731ddb1df95177869b3150c79ac54a80737a16abe4662ea6849f084319b Jun 05 13:32:08.709451 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:08.709429 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f8cf447dc-vglbz"] Jun 05 13:32:08.712131 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:32:08.712111 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dc3827_1e5c_4261_bd33_a7fa3535fc39.slice/crio-1ac68d3676efbdf15fca8ea693a3168bb1a0c394facf3d98335e14ce2d029c30 WatchSource:0}: Error finding container 1ac68d3676efbdf15fca8ea693a3168bb1a0c394facf3d98335e14ce2d029c30: Status 404 returned error can't find the container with id 1ac68d3676efbdf15fca8ea693a3168bb1a0c394facf3d98335e14ce2d029c30 Jun 05 13:32:09.119751 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.119639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c589444f-lnpq8" event={"ID":"71f59628-f5f3-4dcd-b75a-ca78b2558dc0","Type":"ContainerStarted","Data":"ff523731ddb1df95177869b3150c79ac54a80737a16abe4662ea6849f084319b"} Jun 05 13:32:09.122057 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.121976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" event={"ID":"e1dc3827-1e5c-4261-bd33-a7fa3535fc39","Type":"ContainerStarted","Data":"1ac68d3676efbdf15fca8ea693a3168bb1a0c394facf3d98335e14ce2d029c30"} Jun 05 13:32:09.126162 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.125050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8pnvg" event={"ID":"0f34352f-a9f4-4af7-9fad-f6c4677d7581","Type":"ContainerStarted","Data":"0eec5dba2f43cd3e1a0ea23f3fe31d0a52aa359581d47d4b10e7d862de439158"} Jun 05 13:32:09.126162 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.126155 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:32:09.130588 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.130566 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764c59b6fc-z8nts" event={"ID":"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd","Type":"ContainerStarted","Data":"2b665cafe3236d0f4949cb7e40ebf12e2dc9367215815659a5284365bf614b34"} Jun 05 13:32:09.140367 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.140323 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-8pnvg" Jun 05 13:32:09.143243 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:09.143004 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-8pnvg" podStartSLOduration=1.738032494 podStartE2EDuration="19.14298826s" totalImagesPullingTime="17.404955766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:09.142740919 +0000 UTC m=+437.957690576" watchObservedRunningTime="2026-06-05 13:32:09.14298826 +0000 UTC m=+437.957937919" Jun 05 13:32:12.154321 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:12.154264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" event={"ID":"e1dc3827-1e5c-4261-bd33-a7fa3535fc39","Type":"ContainerStarted","Data":"c6ec977e8baa853abb22f827ac62b003fa66e14c3ea299bc412abf6d438ecd9b"} Jun 05 13:32:12.171570 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:12.171514 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" podStartSLOduration=7.51327279 podStartE2EDuration="10.17149343s" totalImagesPullingTime="2.65822064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:12.170518139 +0000 UTC m=+440.985467797" watchObservedRunningTime="2026-06-05 13:32:12.17149343 +0000 UTC m=+440.986443087" Jun 05 13:32:13.049093 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.049059 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bd95566f8-vlczq" Jun 05 13:32:13.203671 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.203614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:13.378692 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.378577 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:13.479441 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.479402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:13.500250 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.500199 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" containerID="cri-o://880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55" gracePeriod=30 Jun 05 13:32:13.774991 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.774930 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:13.830932 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:13.830893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:14.166304 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.166264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764c59b6fc-z8nts" event={"ID":"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd","Type":"ContainerStarted","Data":"bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0"} Jun 05 13:32:14.169585 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.169352 2579 generic.go:356] "Generic (PLEG): container finished" podID="2491609e-3caa-488a-b470-c1557a54814a" containerID="880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55" exitCode=0 Jun 05 13:32:14.169585 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.169480 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerDied","Data":"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55"} Jun 05 13:32:14.169585 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.169538 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:32:14.169585 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.169555 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerStarted","Data":"dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a"} Jun 05 13:32:14.169903 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.169605 2579 scope.go:117] "RemoveContainer" containerID="b12daa6d7589d947725f470a8cf2dc98f75eac54aa918b2ac6d21342a415ab6b" Jun 05 13:32:14.171904 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.171878 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c589444f-lnpq8" event={"ID":"71f59628-f5f3-4dcd-b75a-ca78b2558dc0","Type":"ContainerStarted","Data":"1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce"} Jun 05 13:32:14.186738 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.186443 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-764c59b6fc-z8nts" podStartSLOduration=6.459741001 podStartE2EDuration="11.186418948s" totalImagesPullingTime="4.726677947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:14.184382698 +0000 UTC m=+442.999332367" watchObservedRunningTime="2026-06-05 13:32:14.186418948 +0000 UTC m=+443.001368607" Jun 05 13:32:14.203150 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.203094 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56c589444f-lnpq8" podStartSLOduration=2.484097461 podStartE2EDuration="7.203055559s" totalImagesPullingTime="4.718958098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:14.201942725 +0000 UTC m=+443.016892381" watchObservedRunningTime="2026-06-05 13:32:14.203055559 +0000 UTC m=+443.018005241" Jun 05 13:32:14.323348 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:14.323303 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:17.972791 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:17.972753 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:17.973312 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:17.972809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:17.977703 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:17.977682 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:18.196210 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:18.196177 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:32:18.348428 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:18.348353 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:18.447810 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:18.447764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:18.549708 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:18.549663 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:18.957202 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:18.957163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:19.318746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:19.318662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:19.419533 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:19.419494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:22.848822 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:22.848788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:22.949327 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:22.949287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:23.003465 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:23.003430 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:23.003626 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:23.003493 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:34.175150 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:34.175119 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:32:39.197580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.197540 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-764c59b6fc-z8nts" podUID="0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" containerName="console" containerID="cri-o://bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0" gracePeriod=15 Jun 05 13:32:39.202051 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.202009 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" containerID="cri-o://dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a" gracePeriod=30 Jun 05 13:32:39.504141 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.504103 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:39.520199 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.520168 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:32:39.670861 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.670820 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-oauth-serving-cert\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671038 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.670871 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7cj\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-kube-api-access-dq7cj\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671038 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.670908 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-serving-cert\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671038 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.670940 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-installation-pull-secrets\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671038 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.670980 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-service-ca\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671038 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671013 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-oauth-config\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-image-registry-private-configuration\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671070 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-config\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671095 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m6xp\" (UniqueName: \"kubernetes.io/projected/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-kube-api-access-5m6xp\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671120 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-trusted-ca\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671158 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2491609e-3caa-488a-b470-c1557a54814a-ca-trust-extracted\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671240 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671276 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-trusted-ca-bundle\") pod \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\" (UID: \"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd\") " Jun 05 13:32:39.671320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671323 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-registry-certificates\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671716 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671338 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.671716 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671355 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-bound-sa-token\") pod \"2491609e-3caa-488a-b470-c1557a54814a\" (UID: \"2491609e-3caa-488a-b470-c1557a54814a\") " Jun 05 13:32:39.671716 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.671596 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-oauth-serving-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.672728 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.672120 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.672728 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.672462 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-config" (OuterVolumeSpecName: "console-config") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.672728 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.672608 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.672728 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.672704 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.672728 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.672705 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.673908 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.673877 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:39.674019 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.673934 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-kube-api-access-dq7cj" (OuterVolumeSpecName: "kube-api-access-dq7cj") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "kube-api-access-dq7cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.674321 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.674286 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:39.674321 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.674312 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.674482 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.674442 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:39.674525 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.674484 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:39.675284 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.675264 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.675392 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.675370 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-kube-api-access-5m6xp" (OuterVolumeSpecName: "kube-api-access-5m6xp") pod "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" (UID: "0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd"). InnerVolumeSpecName "kube-api-access-5m6xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.680834 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.680809 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2491609e-3caa-488a-b470-c1557a54814a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2491609e-3caa-488a-b470-c1557a54814a" (UID: "2491609e-3caa-488a-b470-c1557a54814a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772664 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-serving-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772696 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-installation-pull-secrets\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772708 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-service-ca\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772717 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-oauth-config\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772726 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2491609e-3caa-488a-b470-c1557a54814a-image-registry-private-configuration\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772737 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-console-config\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772745 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m6xp\" (UniqueName: \"kubernetes.io/projected/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-kube-api-access-5m6xp\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772753 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-trusted-ca\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.772757 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772761 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2491609e-3caa-488a-b470-c1557a54814a-ca-trust-extracted\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.773144 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772770 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-registry-tls\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.773144 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772779 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd-trusted-ca-bundle\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.773144 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772787 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2491609e-3caa-488a-b470-c1557a54814a-registry-certificates\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.773144 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772795 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-bound-sa-token\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.773144 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:39.772803 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq7cj\" (UniqueName: \"kubernetes.io/projected/2491609e-3caa-488a-b470-c1557a54814a-kube-api-access-dq7cj\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:32:40.273837 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.273795 2579 generic.go:356] "Generic (PLEG): container finished" podID="0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" containerID="bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0" exitCode=0 Jun 05 13:32:40.274375 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.273867 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764c59b6fc-z8nts" Jun 05 13:32:40.274375 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.273888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764c59b6fc-z8nts" event={"ID":"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd","Type":"ContainerDied","Data":"bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0"} Jun 05 13:32:40.274375 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.273962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764c59b6fc-z8nts" event={"ID":"0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd","Type":"ContainerDied","Data":"2b665cafe3236d0f4949cb7e40ebf12e2dc9367215815659a5284365bf614b34"} Jun 05 13:32:40.274375 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.273994 2579 scope.go:117] "RemoveContainer" containerID="bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0" Jun 05 13:32:40.275671 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.275621 2579 generic.go:356] "Generic (PLEG): container finished" podID="2491609e-3caa-488a-b470-c1557a54814a" containerID="dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a" exitCode=0 Jun 05 13:32:40.275726 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.275679 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" Jun 05 13:32:40.275726 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.275696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerDied","Data":"dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a"} Jun 05 13:32:40.275800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.275745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddbbd677-p75gm" event={"ID":"2491609e-3caa-488a-b470-c1557a54814a","Type":"ContainerDied","Data":"7a5074a9a3db63d7bfdce03c966a33f2de4cf24be35fa0fc8973ee333fe31df6"} Jun 05 13:32:40.284870 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.284756 2579 scope.go:117] "RemoveContainer" containerID="bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0" Jun 05 13:32:40.285259 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:32:40.285231 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0\": container with ID starting with bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0 not found: ID does not exist" containerID="bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0" Jun 05 13:32:40.285376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.285268 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0"} err="failed to get container status \"bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0\": rpc error: code = NotFound desc = could not find container \"bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0\": container with ID starting with bac8ea990c8bd5c9197cee5a98c7107d613f8548fabb7863f8e2b17b868ebed0 not found: ID does not exist" Jun 05 13:32:40.285376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.285297 2579 scope.go:117] "RemoveContainer" containerID="dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a" Jun 05 13:32:40.293290 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.293271 2579 scope.go:117] "RemoveContainer" containerID="880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55" Jun 05 13:32:40.297566 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.297541 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764c59b6fc-z8nts"] Jun 05 13:32:40.299934 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.299906 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-764c59b6fc-z8nts"] Jun 05 13:32:40.300953 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.300940 2579 scope.go:117] "RemoveContainer" containerID="dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a" Jun 05 13:32:40.301270 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:32:40.301250 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a\": container with ID starting with dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a not found: ID does not exist" containerID="dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a" Jun 05 13:32:40.301344 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.301278 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a"} err="failed to get container status \"dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a\": rpc error: code = NotFound desc = could not find container \"dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a\": container with ID starting with dd2a85b16ad2f9152d47ab69a73f7f17cf561b959eeb9bcb94e7d5075e5ca99a not found: ID does not exist" Jun 05 13:32:40.301344 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.301301 2579 scope.go:117] "RemoveContainer" containerID="880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55" Jun 05 13:32:40.301580 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:32:40.301562 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55\": container with ID starting with 880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55 not found: ID does not exist" containerID="880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55" Jun 05 13:32:40.301630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.301591 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55"} err="failed to get container status \"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55\": rpc error: code = NotFound desc = could not find container \"880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55\": container with ID starting with 880e0145664b747ceee96592e42b664f02e72cb849c76c6dc48e7bf7288b7d55 not found: ID does not exist" Jun 05 13:32:40.310947 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.310924 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ddbbd677-p75gm"] Jun 05 13:32:40.315206 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.315185 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ddbbd677-p75gm"] Jun 05 13:32:40.967317 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:40.967263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:41.068188 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:41.068157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:41.126512 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:41.126235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:41.267735 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:41.267640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:41.619189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:41.619116 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" path="/var/lib/kubelet/pods/0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd/volumes" Jun 05 13:32:41.619544 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:41.619520 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2491609e-3caa-488a-b470-c1557a54814a" path="/var/lib/kubelet/pods/2491609e-3caa-488a-b470-c1557a54814a/volumes" Jun 05 13:32:43.008241 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:43.008200 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:43.012143 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:43.012117 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f8cf447dc-vglbz" Jun 05 13:32:49.318829 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:49.318785 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:49.369298 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:49.369260 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:32:49.663576 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:32:49.663490 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:24.364959 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:24.364916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:24.449867 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:24.449831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:26.435885 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.435846 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9bf44c45d-h9p4w"] Jun 05 13:33:26.436350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436298 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" containerName="console" Jun 05 13:33:26.436350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436318 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" containerName="console" Jun 05 13:33:26.436350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436333 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436340 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436351 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436360 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436368 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436375 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436391 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436399 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436475 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436489 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436499 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea3cab1-0c53-40e4-ae9d-e90ba7af73bd" containerName="console" Jun 05 13:33:26.436611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.436509 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:33:26.438657 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.438633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.452012 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.451988 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bf44c45d-h9p4w"] Jun 05 13:33:26.496739 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.496705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:26.535059 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-oauth-serving-cert\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.535178 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmgw\" (UniqueName: \"kubernetes.io/projected/6a115751-b836-4174-84ba-4fd990c9cdd3-kube-api-access-pwmgw\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.535178 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-trusted-ca-bundle\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.535178 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-service-ca\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.535178 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-serving-cert\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.535335 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-console-config\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.535335 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.535289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-oauth-config\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.569271 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.569243 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:26.635736 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-oauth-serving-cert\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.635882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmgw\" (UniqueName: \"kubernetes.io/projected/6a115751-b836-4174-84ba-4fd990c9cdd3-kube-api-access-pwmgw\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.635882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-trusted-ca-bundle\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.635882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-service-ca\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.635882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-serving-cert\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.635882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-console-config\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.636131 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.635890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-oauth-config\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.636537 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.636490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-oauth-serving-cert\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.636649 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.636591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-console-config\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.636694 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.636656 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-service-ca\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.636694 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.636674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-trusted-ca-bundle\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.638402 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.638383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-oauth-config\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.638460 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.638443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-serving-cert\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.643933 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.643908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmgw\" (UniqueName: \"kubernetes.io/projected/6a115751-b836-4174-84ba-4fd990c9cdd3-kube-api-access-pwmgw\") pod \"console-9bf44c45d-h9p4w\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.748285 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.748177 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:26.872250 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:26.872212 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bf44c45d-h9p4w"] Jun 05 13:33:26.874836 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:33:26.874808 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a115751_b836_4174_84ba_4fd990c9cdd3.slice/crio-de216f7d16d1a916a38f53731977ae1a6e930db18bcac14e374734026903b921 WatchSource:0}: Error finding container de216f7d16d1a916a38f53731977ae1a6e930db18bcac14e374734026903b921: Status 404 returned error can't find the container with id de216f7d16d1a916a38f53731977ae1a6e930db18bcac14e374734026903b921 Jun 05 13:33:27.456053 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:27.456017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bf44c45d-h9p4w" event={"ID":"6a115751-b836-4174-84ba-4fd990c9cdd3","Type":"ContainerStarted","Data":"794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a"} Jun 05 13:33:27.456456 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:27.456064 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bf44c45d-h9p4w" event={"ID":"6a115751-b836-4174-84ba-4fd990c9cdd3","Type":"ContainerStarted","Data":"de216f7d16d1a916a38f53731977ae1a6e930db18bcac14e374734026903b921"} Jun 05 13:33:36.304401 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:36.304317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:36.415310 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:36.415270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:36.749108 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:36.749079 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:36.749322 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:36.749160 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:36.753569 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:36.753547 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:36.771094 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:36.771049 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9bf44c45d-h9p4w" podStartSLOduration=10.771034422 podStartE2EDuration="10.771034422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:33:27.474922255 +0000 UTC m=+516.289871912" watchObservedRunningTime="2026-06-05 13:33:36.771034422 +0000 UTC m=+525.585984077" Jun 05 13:33:37.499672 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:37.499644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:33:37.545165 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:37.545127 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c589444f-lnpq8"] Jun 05 13:33:37.643206 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:37.643170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:37.693384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:37.693350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:37.745354 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:37.745318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:49.322013 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:49.321977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:49.422423 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:49.422391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:49.475597 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:49.475570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:33:58.472923 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:33:58.472887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:34:02.564783 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.564721 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56c589444f-lnpq8" podUID="71f59628-f5f3-4dcd-b75a-ca78b2558dc0" containerName="console" containerID="cri-o://1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce" gracePeriod=15 Jun 05 13:34:02.812117 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.812093 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:34:02.834029 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.833895 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-oauth-config\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.834029 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.833946 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-trusted-ca-bundle\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.834029 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.833968 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-service-ca\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.834029 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.833988 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-config\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.834083 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-oauth-serving-cert\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.834113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkk57\" (UniqueName: \"kubernetes.io/projected/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-kube-api-access-qkk57\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.834146 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-serving-cert\") pod \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\" (UID: \"71f59628-f5f3-4dcd-b75a-ca78b2558dc0\") " Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.834510 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-config" (OuterVolumeSpecName: "console-config") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.834565 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.834572 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-service-ca" (OuterVolumeSpecName: "service-ca") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:34:02.835359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.835036 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:34:02.836910 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.836875 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:34:02.836910 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.836892 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:34:02.837047 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.836968 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-kube-api-access-qkk57" (OuterVolumeSpecName: "kube-api-access-qkk57") pod "71f59628-f5f3-4dcd-b75a-ca78b2558dc0" (UID: "71f59628-f5f3-4dcd-b75a-ca78b2558dc0"). InnerVolumeSpecName "kube-api-access-qkk57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:34:02.934890 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934863 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-oauth-serving-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:02.934890 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934887 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkk57\" (UniqueName: \"kubernetes.io/projected/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-kube-api-access-qkk57\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:02.934890 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934897 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-serving-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:02.935125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934905 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-oauth-config\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:02.935125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934913 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-trusted-ca-bundle\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:02.935125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934922 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-service-ca\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:02.935125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:02.934945 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71f59628-f5f3-4dcd-b75a-ca78b2558dc0-console-config\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:34:03.595331 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.595296 2579 generic.go:356] "Generic (PLEG): container finished" podID="71f59628-f5f3-4dcd-b75a-ca78b2558dc0" containerID="1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce" exitCode=0 Jun 05 13:34:03.595732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.595339 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c589444f-lnpq8" Jun 05 13:34:03.595732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.595340 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c589444f-lnpq8" event={"ID":"71f59628-f5f3-4dcd-b75a-ca78b2558dc0","Type":"ContainerDied","Data":"1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce"} Jun 05 13:34:03.595732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.595489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c589444f-lnpq8" event={"ID":"71f59628-f5f3-4dcd-b75a-ca78b2558dc0","Type":"ContainerDied","Data":"ff523731ddb1df95177869b3150c79ac54a80737a16abe4662ea6849f084319b"} Jun 05 13:34:03.595732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.595516 2579 scope.go:117] "RemoveContainer" containerID="1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce" Jun 05 13:34:03.603800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.603780 2579 scope.go:117] "RemoveContainer" containerID="1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce" Jun 05 13:34:03.604069 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:34:03.604050 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce\": container with ID starting with 1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce not found: ID does not exist" containerID="1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce" Jun 05 13:34:03.604119 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.604076 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce"} err="failed to get container status \"1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce\": rpc error: code = NotFound desc = could not find container \"1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce\": container with ID starting with 1eee7453a2b1710d522fb6b5e3a46e1a9b9ae025e596ac179191b6cb6ac95cce not found: ID does not exist" Jun 05 13:34:03.618697 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.618674 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c589444f-lnpq8"] Jun 05 13:34:03.620252 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:03.620207 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56c589444f-lnpq8"] Jun 05 13:34:05.618341 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:05.618312 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f59628-f5f3-4dcd-b75a-ca78b2558dc0" path="/var/lib/kubelet/pods/71f59628-f5f3-4dcd-b75a-ca78b2558dc0/volumes" Jun 05 13:34:31.643327 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:31.643275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:34:51.590466 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:51.590439 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:34:51.590873 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:34:51.590440 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:36:03.490034 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:36:03.489997 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:36:10.845777 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:36:10.845733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:36:10.902023 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:36:10.901995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:36:34.533389 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:36:34.533310 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:21.968922 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.968883 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54568b78b-jxfxt"] Jun 05 13:37:21.969612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.969154 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:37:21.969612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.969164 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:37:21.969612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.969182 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f59628-f5f3-4dcd-b75a-ca78b2558dc0" containerName="console" Jun 05 13:37:21.969612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.969187 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f59628-f5f3-4dcd-b75a-ca78b2558dc0" containerName="console" Jun 05 13:37:21.969612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.969261 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:37:21.969612 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.969273 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f59628-f5f3-4dcd-b75a-ca78b2558dc0" containerName="console" Jun 05 13:37:21.971210 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.971186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:21.992346 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:21.992313 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54568b78b-jxfxt"] Jun 05 13:37:22.021234 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.021194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:22.063782 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.063741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8474f93-213a-43cd-becc-f3dad7339776-console-serving-cert\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.063782 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.063785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-trusted-ca-bundle\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.064065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.063807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-console-config\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.064065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.063824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4bbk\" (UniqueName: \"kubernetes.io/projected/b8474f93-213a-43cd-becc-f3dad7339776-kube-api-access-t4bbk\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.064065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.063920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8474f93-213a-43cd-becc-f3dad7339776-console-oauth-config\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.064065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.063968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-service-ca\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.064065 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.064029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-oauth-serving-cert\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.076888 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.076852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:22.165212 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8474f93-213a-43cd-becc-f3dad7339776-console-serving-cert\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.165384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-trusted-ca-bundle\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.165384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-console-config\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.165384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4bbk\" (UniqueName: \"kubernetes.io/projected/b8474f93-213a-43cd-becc-f3dad7339776-kube-api-access-t4bbk\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.165384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8474f93-213a-43cd-becc-f3dad7339776-console-oauth-config\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.165384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-service-ca\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.165384 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.165356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-oauth-serving-cert\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.166089 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.166065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-console-config\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.166212 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.166169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-oauth-serving-cert\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.166212 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.166186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-service-ca\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.166330 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.166296 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8474f93-213a-43cd-becc-f3dad7339776-trusted-ca-bundle\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.167901 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.167874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8474f93-213a-43cd-becc-f3dad7339776-console-oauth-config\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.167980 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.167925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8474f93-213a-43cd-becc-f3dad7339776-console-serving-cert\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.173659 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.173638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4bbk\" (UniqueName: \"kubernetes.io/projected/b8474f93-213a-43cd-becc-f3dad7339776-kube-api-access-t4bbk\") pod \"console-54568b78b-jxfxt\" (UID: \"b8474f93-213a-43cd-becc-f3dad7339776\") " pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.280748 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.280657 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:22.407341 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:22.407315 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54568b78b-jxfxt"] Jun 05 13:37:22.409948 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:37:22.409916 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8474f93_213a_43cd_becc_f3dad7339776.slice/crio-ee07bababae705e8ca169fe44eb9dafcce18d96447e6849a00363614cfa7230c WatchSource:0}: Error finding container ee07bababae705e8ca169fe44eb9dafcce18d96447e6849a00363614cfa7230c: Status 404 returned error can't find the container with id ee07bababae705e8ca169fe44eb9dafcce18d96447e6849a00363614cfa7230c Jun 05 13:37:23.316811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:23.316772 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54568b78b-jxfxt" event={"ID":"b8474f93-213a-43cd-becc-f3dad7339776","Type":"ContainerStarted","Data":"af3cc8607f187bb2edc41ebdc292775b734372a6670688a729271296120871f7"} Jun 05 13:37:23.317187 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:23.316826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54568b78b-jxfxt" event={"ID":"b8474f93-213a-43cd-becc-f3dad7339776","Type":"ContainerStarted","Data":"ee07bababae705e8ca169fe44eb9dafcce18d96447e6849a00363614cfa7230c"} Jun 05 13:37:23.335600 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:23.335551 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54568b78b-jxfxt" podStartSLOduration=2.335536091 podStartE2EDuration="2.335536091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:37:23.334364925 +0000 UTC m=+752.149314595" watchObservedRunningTime="2026-06-05 13:37:23.335536091 +0000 UTC m=+752.150485746" Jun 05 13:37:32.281529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.281431 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:32.281529 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.281501 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:32.287383 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.287357 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:32.356910 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.356883 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54568b78b-jxfxt" Jun 05 13:37:32.401585 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.401540 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bf44c45d-h9p4w"] Jun 05 13:37:32.503162 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.503126 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:32.553822 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.553737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:32.611420 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:32.611385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:43.980714 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:43.980676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:37:57.427136 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.427068 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9bf44c45d-h9p4w" podUID="6a115751-b836-4174-84ba-4fd990c9cdd3" containerName="console" containerID="cri-o://794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a" gracePeriod=15 Jun 05 13:37:57.497004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.496960 2579 patch_prober.go:28] interesting pod/console-9bf44c45d-h9p4w container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 05 13:37:57.497190 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.497024 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-9bf44c45d-h9p4w" podUID="6a115751-b836-4174-84ba-4fd990c9cdd3" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 05 13:37:57.668227 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.668190 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:37:57.709350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709273 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-service-ca\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709304 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-serving-cert\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709330 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-oauth-serving-cert\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709366 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-trusted-ca-bundle\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709387 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-oauth-config\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709418 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-console-config\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709436 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwmgw\" (UniqueName: \"kubernetes.io/projected/6a115751-b836-4174-84ba-4fd990c9cdd3-kube-api-access-pwmgw\") pod \"6a115751-b836-4174-84ba-4fd990c9cdd3\" (UID: \"6a115751-b836-4174-84ba-4fd990c9cdd3\") " Jun 05 13:37:57.709841 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709764 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:37:57.709897 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.709868 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:37:57.710062 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.710030 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:37:57.710142 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.710103 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-console-config" (OuterVolumeSpecName: "console-config") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:37:57.711635 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.711609 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:37:57.711787 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.711772 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:37:57.711897 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.711874 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a115751-b836-4174-84ba-4fd990c9cdd3-kube-api-access-pwmgw" (OuterVolumeSpecName: "kube-api-access-pwmgw") pod "6a115751-b836-4174-84ba-4fd990c9cdd3" (UID: "6a115751-b836-4174-84ba-4fd990c9cdd3"). InnerVolumeSpecName "kube-api-access-pwmgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:37:57.809988 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.809952 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-oauth-serving-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:57.809988 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.809981 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-trusted-ca-bundle\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:57.809988 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.809990 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-oauth-config\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:57.810246 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.810000 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-console-config\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:57.810246 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.810009 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwmgw\" (UniqueName: \"kubernetes.io/projected/6a115751-b836-4174-84ba-4fd990c9cdd3-kube-api-access-pwmgw\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:57.810246 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.810018 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a115751-b836-4174-84ba-4fd990c9cdd3-service-ca\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:57.810246 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:57.810025 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a115751-b836-4174-84ba-4fd990c9cdd3-console-serving-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:37:58.456111 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.456077 2579 generic.go:356] "Generic (PLEG): container finished" podID="6a115751-b836-4174-84ba-4fd990c9cdd3" containerID="794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a" exitCode=0 Jun 05 13:37:58.456594 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.456125 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bf44c45d-h9p4w" Jun 05 13:37:58.456594 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.456149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bf44c45d-h9p4w" event={"ID":"6a115751-b836-4174-84ba-4fd990c9cdd3","Type":"ContainerDied","Data":"794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a"} Jun 05 13:37:58.456594 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.456191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bf44c45d-h9p4w" event={"ID":"6a115751-b836-4174-84ba-4fd990c9cdd3","Type":"ContainerDied","Data":"de216f7d16d1a916a38f53731977ae1a6e930db18bcac14e374734026903b921"} Jun 05 13:37:58.456594 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.456211 2579 scope.go:117] "RemoveContainer" containerID="794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a" Jun 05 13:37:58.464562 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.464545 2579 scope.go:117] "RemoveContainer" containerID="794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a" Jun 05 13:37:58.464817 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:37:58.464798 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a\": container with ID starting with 794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a not found: ID does not exist" containerID="794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a" Jun 05 13:37:58.464869 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.464828 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a"} err="failed to get container status \"794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a\": rpc error: code = NotFound desc = could not find container \"794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a\": container with ID starting with 794728e2509075c0bca3128e0c57356c4b597dc38ff1476c112d9bfd80e7dd4a not found: ID does not exist" Jun 05 13:37:58.475584 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.475559 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bf44c45d-h9p4w"] Jun 05 13:37:58.479086 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:58.479065 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9bf44c45d-h9p4w"] Jun 05 13:37:59.619469 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:37:59.619433 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a115751-b836-4174-84ba-4fd990c9cdd3" path="/var/lib/kubelet/pods/6a115751-b836-4174-84ba-4fd990c9cdd3/volumes" Jun 05 13:38:13.221744 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:13.221663 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:13.316868 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:13.316831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:34.529752 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:34.529716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:35.894779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:35.894745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:36.504581 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.504542 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k"] Jun 05 13:38:36.505435 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.505410 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a115751-b836-4174-84ba-4fd990c9cdd3" containerName="console" Jun 05 13:38:36.505591 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.505580 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a115751-b836-4174-84ba-4fd990c9cdd3" containerName="console" Jun 05 13:38:36.505831 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.505819 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a115751-b836-4174-84ba-4fd990c9cdd3" containerName="console" Jun 05 13:38:36.505931 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.505921 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2491609e-3caa-488a-b470-c1557a54814a" containerName="registry" Jun 05 13:38:36.508376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.508357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.513243 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.513204 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:38:36.513516 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.513500 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 13:38:36.513790 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.513775 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vcz9f\"" Jun 05 13:38:36.519791 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.519771 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k"] Jun 05 13:38:36.595746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.595715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpssm\" (UniqueName: \"kubernetes.io/projected/a0eb80fa-c447-4c7e-a3c5-48099c332bfc-kube-api-access-jpssm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9lk4k\" (UID: \"a0eb80fa-c447-4c7e-a3c5-48099c332bfc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.595883 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.595764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0eb80fa-c447-4c7e-a3c5-48099c332bfc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9lk4k\" (UID: \"a0eb80fa-c447-4c7e-a3c5-48099c332bfc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.697017 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.696977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0eb80fa-c447-4c7e-a3c5-48099c332bfc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9lk4k\" (UID: \"a0eb80fa-c447-4c7e-a3c5-48099c332bfc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.697181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.697079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpssm\" (UniqueName: \"kubernetes.io/projected/a0eb80fa-c447-4c7e-a3c5-48099c332bfc-kube-api-access-jpssm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9lk4k\" (UID: \"a0eb80fa-c447-4c7e-a3c5-48099c332bfc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.697365 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.697345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0eb80fa-c447-4c7e-a3c5-48099c332bfc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9lk4k\" (UID: \"a0eb80fa-c447-4c7e-a3c5-48099c332bfc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.705452 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.705429 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpssm\" (UniqueName: \"kubernetes.io/projected/a0eb80fa-c447-4c7e-a3c5-48099c332bfc-kube-api-access-jpssm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-9lk4k\" (UID: \"a0eb80fa-c447-4c7e-a3c5-48099c332bfc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.817549 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.817465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" Jun 05 13:38:36.948607 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.948574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k"] Jun 05 13:38:36.952316 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:38:36.952291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0eb80fa_c447_4c7e_a3c5_48099c332bfc.slice/crio-48db212bec3824476b6b6cde6817069a4207fb08ac018b60b37f01a36567dd8f WatchSource:0}: Error finding container 48db212bec3824476b6b6cde6817069a4207fb08ac018b60b37f01a36567dd8f: Status 404 returned error can't find the container with id 48db212bec3824476b6b6cde6817069a4207fb08ac018b60b37f01a36567dd8f Jun 05 13:38:36.955101 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:36.955082 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:38:37.608358 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:37.608285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" event={"ID":"a0eb80fa-c447-4c7e-a3c5-48099c332bfc","Type":"ContainerStarted","Data":"48db212bec3824476b6b6cde6817069a4207fb08ac018b60b37f01a36567dd8f"} Jun 05 13:38:38.138173 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:38.138130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:38.240967 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:38.240931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:39.620432 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:39.620353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" event={"ID":"a0eb80fa-c447-4c7e-a3c5-48099c332bfc","Type":"ContainerStarted","Data":"b2d6fe64fa0580ea2d31d5daa90520e70a48e0ae7a867536f0a93b9b98479bda"} Jun 05 13:38:39.643378 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:39.643318 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-9lk4k" podStartSLOduration=1.249473318 podStartE2EDuration="3.643298939s" totalImagesPullingTime="2.393825621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:38:39.640042991 +0000 UTC m=+828.454992673" watchObservedRunningTime="2026-06-05 13:38:39.643298939 +0000 UTC m=+828.458248596" Jun 05 13:38:40.026623 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:40.026592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:40.136926 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:40.136893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:40.236583 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:40.236552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:43.537927 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:43.537885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:43.725559 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:43.725502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:45.127376 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:45.127344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:45.228709 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:45.228674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:50.935545 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:50.935512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:52.272913 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.272856 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-h6ztc"] Jun 05 13:38:52.277363 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.277347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.280319 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.280293 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 13:38:52.281468 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.281451 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-56hhz\"" Jun 05 13:38:52.281562 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.281518 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 13:38:52.286839 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.286817 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h6ztc"] Jun 05 13:38:52.434290 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.434259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ca86b72-5e03-4999-b035-1dfee9aadfaf-bound-sa-token\") pod \"cert-manager-59c77684cc-h6ztc\" (UID: \"6ca86b72-5e03-4999-b035-1dfee9aadfaf\") " pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.434440 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.434305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xn45\" (UniqueName: \"kubernetes.io/projected/6ca86b72-5e03-4999-b035-1dfee9aadfaf-kube-api-access-9xn45\") pod \"cert-manager-59c77684cc-h6ztc\" (UID: \"6ca86b72-5e03-4999-b035-1dfee9aadfaf\") " pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.535474 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.535402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ca86b72-5e03-4999-b035-1dfee9aadfaf-bound-sa-token\") pod \"cert-manager-59c77684cc-h6ztc\" (UID: \"6ca86b72-5e03-4999-b035-1dfee9aadfaf\") " pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.535474 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.535446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xn45\" (UniqueName: \"kubernetes.io/projected/6ca86b72-5e03-4999-b035-1dfee9aadfaf-kube-api-access-9xn45\") pod \"cert-manager-59c77684cc-h6ztc\" (UID: \"6ca86b72-5e03-4999-b035-1dfee9aadfaf\") " pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.543848 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.543819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ca86b72-5e03-4999-b035-1dfee9aadfaf-bound-sa-token\") pod \"cert-manager-59c77684cc-h6ztc\" (UID: \"6ca86b72-5e03-4999-b035-1dfee9aadfaf\") " pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.543991 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.543975 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xn45\" (UniqueName: \"kubernetes.io/projected/6ca86b72-5e03-4999-b035-1dfee9aadfaf-kube-api-access-9xn45\") pod \"cert-manager-59c77684cc-h6ztc\" (UID: \"6ca86b72-5e03-4999-b035-1dfee9aadfaf\") " pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.595630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.595603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h6ztc" Jun 05 13:38:52.726967 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:52.726826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h6ztc"] Jun 05 13:38:52.729432 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:38:52.729401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ca86b72_5e03_4999_b035_1dfee9aadfaf.slice/crio-935cbc096b8d388460bf5748ad4a9a63599d0d27204dec154377a80ce5d274e1 WatchSource:0}: Error finding container 935cbc096b8d388460bf5748ad4a9a63599d0d27204dec154377a80ce5d274e1: Status 404 returned error can't find the container with id 935cbc096b8d388460bf5748ad4a9a63599d0d27204dec154377a80ce5d274e1 Jun 05 13:38:53.677357 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:53.677321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h6ztc" event={"ID":"6ca86b72-5e03-4999-b035-1dfee9aadfaf","Type":"ContainerStarted","Data":"935cbc096b8d388460bf5748ad4a9a63599d0d27204dec154377a80ce5d274e1"} Jun 05 13:38:55.248882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:55.248820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:55.688380 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:55.688349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h6ztc" event={"ID":"6ca86b72-5e03-4999-b035-1dfee9aadfaf","Type":"ContainerStarted","Data":"8426f2c868882d3b5807073b01a58ff5bd9accab7b5bc1939b949e2a185789c2"} Jun 05 13:38:55.707208 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:55.707131 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-h6ztc" podStartSLOduration=1.089733287 podStartE2EDuration="3.707117336s" totalImagesPullingTime="2.617384049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:38:55.70575944 +0000 UTC m=+844.520709096" watchObservedRunningTime="2026-06-05 13:38:55.707117336 +0000 UTC m=+844.522066992" Jun 05 13:38:56.741698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:56.741664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:38:56.838775 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:38:56.838738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:03.015613 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:03.015584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:03.132500 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:03.132453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:03.219410 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:03.219378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:05.343388 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:05.343353 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:15.238979 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:15.238946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:17.744986 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:17.744945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:17.844847 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:17.844815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:18.350201 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.350170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:18.578282 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.578246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:18.671071 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.670984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:18.701792 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.701755 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl"] Jun 05 13:39:18.704427 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.704411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.708111 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.708086 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 13:39:18.708256 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.708127 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 13:39:18.708256 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.708135 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 13:39:18.708256 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.708151 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gbf66\"" Jun 05 13:39:18.708415 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.708259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 13:39:18.725071 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.725041 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl"] Jun 05 13:39:18.729873 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.729844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a79c73f-5bf3-48c2-830c-17c564695af9-tmp\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.729981 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.729931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a79c73f-5bf3-48c2-830c-17c564695af9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.730034 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.729994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a79c73f-5bf3-48c2-830c-17c564695af9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.730076 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.730027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a79c73f-5bf3-48c2-830c-17c564695af9-manifests\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.730125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.730105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shfpf\" (UniqueName: \"kubernetes.io/projected/0a79c73f-5bf3-48c2-830c-17c564695af9-kube-api-access-shfpf\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.827059 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.827031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:18.831138 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.831118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a79c73f-5bf3-48c2-830c-17c564695af9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.831209 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.831160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a79c73f-5bf3-48c2-830c-17c564695af9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.831209 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.831184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a79c73f-5bf3-48c2-830c-17c564695af9-manifests\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.831330 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.831254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfpf\" (UniqueName: \"kubernetes.io/projected/0a79c73f-5bf3-48c2-830c-17c564695af9-kube-api-access-shfpf\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.831330 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.831286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a79c73f-5bf3-48c2-830c-17c564695af9-tmp\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.831596 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.831572 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a79c73f-5bf3-48c2-830c-17c564695af9-manifests\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.833599 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.833572 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a79c73f-5bf3-48c2-830c-17c564695af9-tmp\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.833682 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.833651 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a79c73f-5bf3-48c2-830c-17c564695af9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.833727 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.833684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a79c73f-5bf3-48c2-830c-17c564695af9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.839277 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.839254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shfpf\" (UniqueName: \"kubernetes.io/projected/0a79c73f-5bf3-48c2-830c-17c564695af9-kube-api-access-shfpf\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl\" (UID: \"0a79c73f-5bf3-48c2-830c-17c564695af9\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:18.926439 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:18.926368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:19.014845 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.014812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:19.032359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.032333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:19.146088 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.146055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:19.164817 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.164796 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl"] Jun 05 13:39:19.167699 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:39:19.167672 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a79c73f_5bf3_48c2_830c_17c564695af9.slice/crio-93f7342773eae03bad843655e5beadae267603ea51256b82b91282083558da21 WatchSource:0}: Error finding container 93f7342773eae03bad843655e5beadae267603ea51256b82b91282083558da21: Status 404 returned error can't find the container with id 93f7342773eae03bad843655e5beadae267603ea51256b82b91282083558da21 Jun 05 13:39:19.235577 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.235550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:19.331451 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.331424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:19.429518 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.429492 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:19.797634 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:19.797596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" event={"ID":"0a79c73f-5bf3-48c2-830c-17c564695af9","Type":"ContainerStarted","Data":"93f7342773eae03bad843655e5beadae267603ea51256b82b91282083558da21"} Jun 05 13:39:22.813305 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:22.813268 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" event={"ID":"0a79c73f-5bf3-48c2-830c-17c564695af9","Type":"ContainerStarted","Data":"93754900b8d6719a8dde7adcb4fd716de45cd5909f51468dc45256f0caa32f0e"} Jun 05 13:39:23.819143 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:23.819108 2579 generic.go:356] "Generic (PLEG): container finished" podID="0a79c73f-5bf3-48c2-830c-17c564695af9" containerID="93754900b8d6719a8dde7adcb4fd716de45cd5909f51468dc45256f0caa32f0e" exitCode=0 Jun 05 13:39:23.819544 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:23.819172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" event={"ID":"0a79c73f-5bf3-48c2-830c-17c564695af9","Type":"ContainerDied","Data":"93754900b8d6719a8dde7adcb4fd716de45cd5909f51468dc45256f0caa32f0e"} Jun 05 13:39:24.613020 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:24.612933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:24.672336 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:24.672297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:24.825695 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:24.825662 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" event={"ID":"0a79c73f-5bf3-48c2-830c-17c564695af9","Type":"ContainerStarted","Data":"94b6a7c06d5ebfbec3e9f65e62e35729582617553ed41928d0f3dad0c20ec3f8"} Jun 05 13:39:24.826089 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:24.825793 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:24.848099 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:24.848044 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" podStartSLOduration=2.533770606 podStartE2EDuration="6.848026506s" totalImagesPullingTime="3.297020245s" totalInitContainerRuntime="1.017235655s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:39:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:39:24.845811468 +0000 UTC m=+873.660761138" watchObservedRunningTime="2026-06-05 13:39:24.848026506 +0000 UTC m=+873.662976161" Jun 05 13:39:27.577912 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:27.577865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:27.694742 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:27.694698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:29.311577 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:29.311540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:29.412881 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:29.412833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:35.832732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:35.832644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl" Jun 05 13:39:37.401987 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.401952 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:37.588849 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.588815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:37.717050 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.717020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:37.815563 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.815525 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj"] Jun 05 13:39:37.818805 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.818780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.821346 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.821323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 13:39:37.821346 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.821341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 13:39:37.821556 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.821354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ltfk6\"" Jun 05 13:39:37.826811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.826786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:37.832603 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.832575 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj"] Jun 05 13:39:37.889764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.889734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6130e039-a6c1-4521-a5d1-9fda659a38b4-tls-certs\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.889960 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.889778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6130e039-a6c1-4521-a5d1-9fda659a38b4-tmp\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.889960 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.889823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwwr\" (UniqueName: \"kubernetes.io/projected/6130e039-a6c1-4521-a5d1-9fda659a38b4-kube-api-access-nkwwr\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.934211 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.934171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:37.990654 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.990540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6130e039-a6c1-4521-a5d1-9fda659a38b4-tls-certs\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.990654 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.990611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6130e039-a6c1-4521-a5d1-9fda659a38b4-tmp\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.990654 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.990632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwwr\" (UniqueName: \"kubernetes.io/projected/6130e039-a6c1-4521-a5d1-9fda659a38b4-kube-api-access-nkwwr\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.992923 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.992893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6130e039-a6c1-4521-a5d1-9fda659a38b4-tmp\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:37.993117 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:37.993102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6130e039-a6c1-4521-a5d1-9fda659a38b4-tls-certs\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:38.008627 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.008600 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwwr\" (UniqueName: \"kubernetes.io/projected/6130e039-a6c1-4521-a5d1-9fda659a38b4-kube-api-access-nkwwr\") pod \"kube-auth-proxy-55d7cf4f6c-j98dj\" (UID: \"6130e039-a6c1-4521-a5d1-9fda659a38b4\") " pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:38.128890 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.128848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" Jun 05 13:39:38.160707 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.160676 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rljkj"] Jun 05 13:39:38.163945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.163923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.166656 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.166636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f2hl5\"" Jun 05 13:39:38.166805 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.166784 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 13:39:38.180727 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.180701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rljkj"] Jun 05 13:39:38.221909 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.221875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:38.244541 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.244467 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz"] Jun 05 13:39:38.247996 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.247970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.250633 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.250608 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 13:39:38.250767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.250631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 13:39:38.250767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.250754 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-76jt6\"" Jun 05 13:39:38.250886 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.250759 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 13:39:38.250886 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.250844 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 13:39:38.250886 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.250843 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:39:38.258643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.258620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz"] Jun 05 13:39:38.274451 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.274423 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj"] Jun 05 13:39:38.277876 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:39:38.277855 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6130e039_a6c1_4521_a5d1_9fda659a38b4.slice/crio-87282b3e02afeda8d85205e9bbab989650b34402cee6a97cbc377647f1619942 WatchSource:0}: Error finding container 87282b3e02afeda8d85205e9bbab989650b34402cee6a97cbc377647f1619942: Status 404 returned error can't find the container with id 87282b3e02afeda8d85205e9bbab989650b34402cee6a97cbc377647f1619942 Jun 05 13:39:38.293777 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.293751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3194239a-25de-4018-b248-1a627721f2d3-cert\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.293926 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.293785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbt5z\" (UniqueName: \"kubernetes.io/projected/3194239a-25de-4018-b248-1a627721f2d3-kube-api-access-tbt5z\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.319771 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.319725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:38.395112 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.395072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3194239a-25de-4018-b248-1a627721f2d3-cert\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.395112 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.395123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5z\" (UniqueName: \"kubernetes.io/projected/3194239a-25de-4018-b248-1a627721f2d3-kube-api-access-tbt5z\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.395418 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.395188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58d29719-53f3-440d-ab38-daaa155ed393-cert\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.395418 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.395275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58d29719-53f3-440d-ab38-daaa155ed393-manager-config\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.395418 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.395310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4ps\" (UniqueName: \"kubernetes.io/projected/58d29719-53f3-440d-ab38-daaa155ed393-kube-api-access-vp4ps\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.395418 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:39:38.395322 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 13:39:38.395418 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:39:38.395384 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3194239a-25de-4018-b248-1a627721f2d3-cert podName:3194239a-25de-4018-b248-1a627721f2d3 nodeName:}" failed. No retries permitted until 2026-06-05 13:39:38.895368739 +0000 UTC m=+887.710318373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3194239a-25de-4018-b248-1a627721f2d3-cert") pod "odh-model-controller-6dc94f689f-rljkj" (UID: "3194239a-25de-4018-b248-1a627721f2d3") : secret "odh-model-controller-webhook-cert" not found Jun 05 13:39:38.395616 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.395425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58d29719-53f3-440d-ab38-daaa155ed393-metrics-cert\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.413174 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.413140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt5z\" (UniqueName: \"kubernetes.io/projected/3194239a-25de-4018-b248-1a627721f2d3-kube-api-access-tbt5z\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.414419 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.414398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:38.496746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.496662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58d29719-53f3-440d-ab38-daaa155ed393-cert\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.496746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.496701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58d29719-53f3-440d-ab38-daaa155ed393-manager-config\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.496746 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.496732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4ps\" (UniqueName: \"kubernetes.io/projected/58d29719-53f3-440d-ab38-daaa155ed393-kube-api-access-vp4ps\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.497030 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.496780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58d29719-53f3-440d-ab38-daaa155ed393-metrics-cert\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.497380 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.497354 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58d29719-53f3-440d-ab38-daaa155ed393-manager-config\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.499294 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.499275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58d29719-53f3-440d-ab38-daaa155ed393-metrics-cert\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.499374 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.499326 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58d29719-53f3-440d-ab38-daaa155ed393-cert\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.504983 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.504953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4ps\" (UniqueName: \"kubernetes.io/projected/58d29719-53f3-440d-ab38-daaa155ed393-kube-api-access-vp4ps\") pod \"lws-controller-manager-686f455b98-tnkjz\" (UID: \"58d29719-53f3-440d-ab38-daaa155ed393\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.521079 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.521048 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:38.558393 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.558353 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:38.683077 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.683050 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz"] Jun 05 13:39:38.685732 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:39:38.685697 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d29719_53f3_440d_ab38_daaa155ed393.slice/crio-e9154fbb815b53a5e4bfe0e2916f1c2f73cde7bf17a96d7b2760c760596e08a9 WatchSource:0}: Error finding container e9154fbb815b53a5e4bfe0e2916f1c2f73cde7bf17a96d7b2760c760596e08a9: Status 404 returned error can't find the container with id e9154fbb815b53a5e4bfe0e2916f1c2f73cde7bf17a96d7b2760c760596e08a9 Jun 05 13:39:38.860054 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.859973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:38.886958 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.886913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" event={"ID":"58d29719-53f3-440d-ab38-daaa155ed393","Type":"ContainerStarted","Data":"e9154fbb815b53a5e4bfe0e2916f1c2f73cde7bf17a96d7b2760c760596e08a9"} Jun 05 13:39:38.888639 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.888608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" event={"ID":"6130e039-a6c1-4521-a5d1-9fda659a38b4","Type":"ContainerStarted","Data":"87282b3e02afeda8d85205e9bbab989650b34402cee6a97cbc377647f1619942"} Jun 05 13:39:38.901981 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.901948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3194239a-25de-4018-b248-1a627721f2d3-cert\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:38.904733 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:38.904710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3194239a-25de-4018-b248-1a627721f2d3-cert\") pod \"odh-model-controller-6dc94f689f-rljkj\" (UID: \"3194239a-25de-4018-b248-1a627721f2d3\") " pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:39.075328 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:39.075196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:39.126821 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:39.126731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:39.252328 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:39.252299 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rljkj"] Jun 05 13:39:39.255730 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:39:39.255694 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3194239a_25de_4018_b248_1a627721f2d3.slice/crio-0fc1480420c339a4b3bc5a235c6b784ce534d7dc446dbbb876253a19273f4325 WatchSource:0}: Error finding container 0fc1480420c339a4b3bc5a235c6b784ce534d7dc446dbbb876253a19273f4325: Status 404 returned error can't find the container with id 0fc1480420c339a4b3bc5a235c6b784ce534d7dc446dbbb876253a19273f4325 Jun 05 13:39:39.897049 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:39.896962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" event={"ID":"3194239a-25de-4018-b248-1a627721f2d3","Type":"ContainerStarted","Data":"0fc1480420c339a4b3bc5a235c6b784ce534d7dc446dbbb876253a19273f4325"} Jun 05 13:39:40.548327 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:40.548297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:40.632644 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:40.632605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:43.925597 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.925512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" event={"ID":"58d29719-53f3-440d-ab38-daaa155ed393","Type":"ContainerStarted","Data":"6f56833f2b594ac217577d54955d4372e92eaa13772ed1b0301a2a17d0fcf3bf"} Jun 05 13:39:43.926031 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.925637 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:43.927127 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.927101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" event={"ID":"6130e039-a6c1-4521-a5d1-9fda659a38b4","Type":"ContainerStarted","Data":"1b043ec1a2e3028887ce7fab761896b2758237a26a23cac7cd54b520e84d3b59"} Jun 05 13:39:43.928505 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.928487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" event={"ID":"3194239a-25de-4018-b248-1a627721f2d3","Type":"ContainerStarted","Data":"7083336da57c920d7de089fc23756534a9b40120567d502cf5ee8ee820f561b8"} Jun 05 13:39:43.928650 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.928635 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:43.943330 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.943290 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" podStartSLOduration=1.014025621 podStartE2EDuration="5.943278637s" totalImagesPullingTime="4.929253016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:39:43.941850915 +0000 UTC m=+892.756800571" watchObservedRunningTime="2026-06-05 13:39:43.943278637 +0000 UTC m=+892.758228271" Jun 05 13:39:43.957563 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.957516 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55d7cf4f6c-j98dj" podStartSLOduration=1.620743457 podStartE2EDuration="6.957502828s" totalImagesPullingTime="5.336759371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:39:43.956745898 +0000 UTC m=+892.771695554" watchObservedRunningTime="2026-06-05 13:39:43.957502828 +0000 UTC m=+892.772452484" Jun 05 13:39:43.973130 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:43.973074 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" podStartSLOduration=1.560235691 podStartE2EDuration="5.973055002s" totalImagesPullingTime="4.412819311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:39:43.971703791 +0000 UTC m=+892.786653448" watchObservedRunningTime="2026-06-05 13:39:43.973055002 +0000 UTC m=+892.788004658" Jun 05 13:39:48.613156 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:48.613123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:48.739459 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:48.739422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:48.849159 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:48.849128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:49.432859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:49.432826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:49.933519 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:49.933488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:50.035079 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:50.035051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:51.616399 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:51.616359 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:39:51.617023 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:51.617004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:39:53.033798 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:53.033767 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:53.167307 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:53.167263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:54.539674 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:54.539646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:54.666189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:54.666151 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:54.934569 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:54.934540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-rljkj" Jun 05 13:39:54.934741 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:54.934623 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-686f455b98-tnkjz" Jun 05 13:39:55.079567 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:55.079529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:55.247337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:55.247261 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:39:56.703722 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:39:56.703684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:06.716013 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:06.715977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:06.812859 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:06.812830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:06.952879 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:06.952843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:07.005934 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:07.005852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:07.262998 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:07.262886 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.090128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.090093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.153526 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.153494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.308366 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.308329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.409323 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.409209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.620703 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.620669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.720985 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.720954 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:11.820851 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:11.820795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:16.441721 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:16.441682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:24.631621 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:24.631581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:24.684619 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:24.684589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:30.803735 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:30.803698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:30.861554 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:30.861516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:35.037589 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:35.037548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:35.092558 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:35.092525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:39.095505 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:39.095475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:39.196382 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:39.196355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:39.291415 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:39.291382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:40.019414 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:40.019373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:40.219908 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:40.219877 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:40.575763 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:40.575731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:40.630683 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:40.630656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:45.123298 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:45.123259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:45.223711 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:45.223677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:54.208049 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:54.208009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:40:54.309284 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:40:54.309253 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:41:29.280989 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.280953 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq"] Jun 05 13:41:29.283440 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.283422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.285771 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.285740 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 05 13:41:29.285923 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.285904 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 13:41:29.286925 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.286904 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 13:41:29.287004 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.286933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 05 13:41:29.287054 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.286935 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qmcbm\"" Jun 05 13:41:29.292021 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.291993 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq"] Jun 05 13:41:29.418767 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.418733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.418948 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.418776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce0b3088-54a7-4d69-a70d-1b66f30deeff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.418948 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.418830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgvq6\" (UniqueName: \"kubernetes.io/projected/ce0b3088-54a7-4d69-a70d-1b66f30deeff-kube-api-access-hgvq6\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.519765 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.519722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.519945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.519788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce0b3088-54a7-4d69-a70d-1b66f30deeff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.519945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.519837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgvq6\" (UniqueName: \"kubernetes.io/projected/ce0b3088-54a7-4d69-a70d-1b66f30deeff-kube-api-access-hgvq6\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.519945 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:41:29.519846 2579 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 05 13:41:29.519945 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:41:29.519930 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert podName:ce0b3088-54a7-4d69-a70d-1b66f30deeff nodeName:}" failed. No retries permitted until 2026-06-05 13:41:30.019913182 +0000 UTC m=+998.834862816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6rzjq" (UID: "ce0b3088-54a7-4d69-a70d-1b66f30deeff") : secret "plugin-serving-cert" not found Jun 05 13:41:29.520545 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.520524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce0b3088-54a7-4d69-a70d-1b66f30deeff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:29.529977 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:29.529955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgvq6\" (UniqueName: \"kubernetes.io/projected/ce0b3088-54a7-4d69-a70d-1b66f30deeff-kube-api-access-hgvq6\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:30.024377 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:30.024326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:30.024573 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:41:30.024490 2579 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 05 13:41:30.024617 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:41:30.024574 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert podName:ce0b3088-54a7-4d69-a70d-1b66f30deeff nodeName:}" failed. No retries permitted until 2026-06-05 13:41:31.024559291 +0000 UTC m=+999.839508930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6rzjq" (UID: "ce0b3088-54a7-4d69-a70d-1b66f30deeff") : secret "plugin-serving-cert" not found Jun 05 13:41:31.035898 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:31.035862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:31.038367 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:31.038336 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b3088-54a7-4d69-a70d-1b66f30deeff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rzjq\" (UID: \"ce0b3088-54a7-4d69-a70d-1b66f30deeff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:31.093677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:31.093642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" Jun 05 13:41:31.229614 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:31.229579 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq"] Jun 05 13:41:31.232591 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:41:31.232559 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce0b3088_54a7_4d69_a70d_1b66f30deeff.slice/crio-5d04d5c99e073bf3a8ebb74313b152126ed46a8b18aa7bbf05d80bf9cb46e817 WatchSource:0}: Error finding container 5d04d5c99e073bf3a8ebb74313b152126ed46a8b18aa7bbf05d80bf9cb46e817: Status 404 returned error can't find the container with id 5d04d5c99e073bf3a8ebb74313b152126ed46a8b18aa7bbf05d80bf9cb46e817 Jun 05 13:41:31.387288 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:31.387174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" event={"ID":"ce0b3088-54a7-4d69-a70d-1b66f30deeff","Type":"ContainerStarted","Data":"5d04d5c99e073bf3a8ebb74313b152126ed46a8b18aa7bbf05d80bf9cb46e817"} Jun 05 13:41:56.521495 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:56.521457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" event={"ID":"ce0b3088-54a7-4d69-a70d-1b66f30deeff","Type":"ContainerStarted","Data":"c8c6ce781296cba8c58ca93faec10b085d70001a211137900ae45b33be69a1a9"} Jun 05 13:41:56.540418 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:41:56.540363 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rzjq" podStartSLOduration=2.6633774150000002 podStartE2EDuration="27.540348511s" totalImagesPullingTime="24.876971096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:41:56.539449705 +0000 UTC m=+1025.354399362" watchObservedRunningTime="2026-06-05 13:41:56.540348511 +0000 UTC m=+1025.355298167" Jun 05 13:42:22.453661 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.453624 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:42:22.489947 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.489913 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:42:22.489947 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.489956 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:42:22.490142 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.490036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.492324 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.492299 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 13:42:22.588920 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.588885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89fb5917-2eed-4149-abef-35ade16b6134-config-file\") pod \"limitador-limitador-54d6d988d5-czwmv\" (UID: \"89fb5917-2eed-4149-abef-35ade16b6134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.589090 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.589002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8t8z\" (UniqueName: \"kubernetes.io/projected/89fb5917-2eed-4149-abef-35ade16b6134-kube-api-access-h8t8z\") pod \"limitador-limitador-54d6d988d5-czwmv\" (UID: \"89fb5917-2eed-4149-abef-35ade16b6134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.690496 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.690450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89fb5917-2eed-4149-abef-35ade16b6134-config-file\") pod \"limitador-limitador-54d6d988d5-czwmv\" (UID: \"89fb5917-2eed-4149-abef-35ade16b6134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.690716 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.690580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8t8z\" (UniqueName: \"kubernetes.io/projected/89fb5917-2eed-4149-abef-35ade16b6134-kube-api-access-h8t8z\") pod \"limitador-limitador-54d6d988d5-czwmv\" (UID: \"89fb5917-2eed-4149-abef-35ade16b6134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.691181 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.691155 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89fb5917-2eed-4149-abef-35ade16b6134-config-file\") pod \"limitador-limitador-54d6d988d5-czwmv\" (UID: \"89fb5917-2eed-4149-abef-35ade16b6134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.699689 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.699669 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8t8z\" (UniqueName: \"kubernetes.io/projected/89fb5917-2eed-4149-abef-35ade16b6134-kube-api-access-h8t8z\") pod \"limitador-limitador-54d6d988d5-czwmv\" (UID: \"89fb5917-2eed-4149-abef-35ade16b6134\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.800953 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.800868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:22.890464 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.890429 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qj4rl"] Jun 05 13:42:22.933175 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.933146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qj4rl"] Jun 05 13:42:22.933325 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.933275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:22.935999 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.935974 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-njxj7\"" Jun 05 13:42:22.968928 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.968890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:42:22.972205 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:42:22.972170 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fb5917_2eed_4149_abef_35ade16b6134.slice/crio-203e3905b0a468b6d4b3ff668d6de828a2cc4524fef8542cbfeedb45d835a8f5 WatchSource:0}: Error finding container 203e3905b0a468b6d4b3ff668d6de828a2cc4524fef8542cbfeedb45d835a8f5: Status 404 returned error can't find the container with id 203e3905b0a468b6d4b3ff668d6de828a2cc4524fef8542cbfeedb45d835a8f5 Jun 05 13:42:22.996302 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:22.996272 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lgzkt"] Jun 05 13:42:23.013794 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.013764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lgzkt"] Jun 05 13:42:23.013945 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.013855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:42:23.093039 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.092944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/1067ea7c-8088-41b4-88e0-5869400ac1ba-kube-api-access-l6ggx\") pod \"authorino-75d556bd77-lgzkt\" (UID: \"1067ea7c-8088-41b4-88e0-5869400ac1ba\") " pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:42:23.093039 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.093021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2m2\" (UniqueName: \"kubernetes.io/projected/31ef2616-f1cf-400a-b14c-3550dfa5774a-kube-api-access-hh2m2\") pod \"authorino-58cd955675-qj4rl\" (UID: \"31ef2616-f1cf-400a-b14c-3550dfa5774a\") " pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:23.194350 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.194309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/1067ea7c-8088-41b4-88e0-5869400ac1ba-kube-api-access-l6ggx\") pod \"authorino-75d556bd77-lgzkt\" (UID: \"1067ea7c-8088-41b4-88e0-5869400ac1ba\") " pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:42:23.194536 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.194396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2m2\" (UniqueName: \"kubernetes.io/projected/31ef2616-f1cf-400a-b14c-3550dfa5774a-kube-api-access-hh2m2\") pod \"authorino-58cd955675-qj4rl\" (UID: \"31ef2616-f1cf-400a-b14c-3550dfa5774a\") " pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:23.202748 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.202716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/1067ea7c-8088-41b4-88e0-5869400ac1ba-kube-api-access-l6ggx\") pod \"authorino-75d556bd77-lgzkt\" (UID: \"1067ea7c-8088-41b4-88e0-5869400ac1ba\") " pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:42:23.202748 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.202729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2m2\" (UniqueName: \"kubernetes.io/projected/31ef2616-f1cf-400a-b14c-3550dfa5774a-kube-api-access-hh2m2\") pod \"authorino-58cd955675-qj4rl\" (UID: \"31ef2616-f1cf-400a-b14c-3550dfa5774a\") " pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:23.244930 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.244907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:23.323657 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.323544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:42:23.401600 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.401567 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qj4rl"] Jun 05 13:42:23.403642 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:42:23.403616 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31ef2616_f1cf_400a_b14c_3550dfa5774a.slice/crio-6713ecaf8af0cb5610991608ffb65aef5fb90f5e55fb720321cf0bda5449a564 WatchSource:0}: Error finding container 6713ecaf8af0cb5610991608ffb65aef5fb90f5e55fb720321cf0bda5449a564: Status 404 returned error can't find the container with id 6713ecaf8af0cb5610991608ffb65aef5fb90f5e55fb720321cf0bda5449a564 Jun 05 13:42:23.465431 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.465399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lgzkt"] Jun 05 13:42:23.467900 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:42:23.467876 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1067ea7c_8088_41b4_88e0_5869400ac1ba.slice/crio-bf105822f997bd8c52f5df27045c9fe1960d8582e2042c01798bcc97570607e5 WatchSource:0}: Error finding container bf105822f997bd8c52f5df27045c9fe1960d8582e2042c01798bcc97570607e5: Status 404 returned error can't find the container with id bf105822f997bd8c52f5df27045c9fe1960d8582e2042c01798bcc97570607e5 Jun 05 13:42:23.648798 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.648717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qj4rl" event={"ID":"31ef2616-f1cf-400a-b14c-3550dfa5774a","Type":"ContainerStarted","Data":"6713ecaf8af0cb5610991608ffb65aef5fb90f5e55fb720321cf0bda5449a564"} Jun 05 13:42:23.650804 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.650772 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lgzkt" event={"ID":"1067ea7c-8088-41b4-88e0-5869400ac1ba","Type":"ContainerStarted","Data":"bf105822f997bd8c52f5df27045c9fe1960d8582e2042c01798bcc97570607e5"} Jun 05 13:42:23.652498 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:23.652463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" event={"ID":"89fb5917-2eed-4149-abef-35ade16b6134","Type":"ContainerStarted","Data":"203e3905b0a468b6d4b3ff668d6de828a2cc4524fef8542cbfeedb45d835a8f5"} Jun 05 13:42:28.686494 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.686459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lgzkt" event={"ID":"1067ea7c-8088-41b4-88e0-5869400ac1ba","Type":"ContainerStarted","Data":"4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8"} Jun 05 13:42:28.688020 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.687993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" event={"ID":"89fb5917-2eed-4149-abef-35ade16b6134","Type":"ContainerStarted","Data":"458f7a884b43720a546bbd018b8158e7e0f6ac5f28f5e17b56a2004cc1c0ce8a"} Jun 05 13:42:28.688140 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.688057 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:28.689328 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.689306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qj4rl" event={"ID":"31ef2616-f1cf-400a-b14c-3550dfa5774a","Type":"ContainerStarted","Data":"83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8"} Jun 05 13:42:28.700806 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.700762 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lgzkt" podStartSLOduration=2.147203696 podStartE2EDuration="6.70074985s" totalImagesPullingTime="4.553546154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:42:28.700183948 +0000 UTC m=+1057.515133605" watchObservedRunningTime="2026-06-05 13:42:28.70074985 +0000 UTC m=+1057.515699509" Jun 05 13:42:28.717764 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.717706 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" podStartSLOduration=1.68133298 podStartE2EDuration="6.717690268s" totalImagesPullingTime="5.036357288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:42:28.716104092 +0000 UTC m=+1057.531053953" watchObservedRunningTime="2026-06-05 13:42:28.717690268 +0000 UTC m=+1057.532639925" Jun 05 13:42:28.729310 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.729284 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qj4rl"] Jun 05 13:42:28.742796 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:28.742755 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qj4rl" podStartSLOduration=2.137280951 podStartE2EDuration="6.742741889s" totalImagesPullingTime="4.605460938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:42:28.740729334 +0000 UTC m=+1057.555678988" watchObservedRunningTime="2026-06-05 13:42:28.742741889 +0000 UTC m=+1057.557691546" Jun 05 13:42:30.697616 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:30.697579 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qj4rl" podUID="31ef2616-f1cf-400a-b14c-3550dfa5774a" containerName="authorino" containerID="cri-o://83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8" gracePeriod=30 Jun 05 13:42:30.948515 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:30.948463 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:31.066075 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.066036 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh2m2\" (UniqueName: \"kubernetes.io/projected/31ef2616-f1cf-400a-b14c-3550dfa5774a-kube-api-access-hh2m2\") pod \"31ef2616-f1cf-400a-b14c-3550dfa5774a\" (UID: \"31ef2616-f1cf-400a-b14c-3550dfa5774a\") " Jun 05 13:42:31.068186 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.068157 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ef2616-f1cf-400a-b14c-3550dfa5774a-kube-api-access-hh2m2" (OuterVolumeSpecName: "kube-api-access-hh2m2") pod "31ef2616-f1cf-400a-b14c-3550dfa5774a" (UID: "31ef2616-f1cf-400a-b14c-3550dfa5774a"). InnerVolumeSpecName "kube-api-access-hh2m2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:42:31.167461 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.167425 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh2m2\" (UniqueName: \"kubernetes.io/projected/31ef2616-f1cf-400a-b14c-3550dfa5774a-kube-api-access-hh2m2\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:42:31.702850 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.702819 2579 generic.go:356] "Generic (PLEG): container finished" podID="31ef2616-f1cf-400a-b14c-3550dfa5774a" containerID="83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8" exitCode=0 Jun 05 13:42:31.703280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.702869 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qj4rl" Jun 05 13:42:31.703280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.702900 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qj4rl" event={"ID":"31ef2616-f1cf-400a-b14c-3550dfa5774a","Type":"ContainerDied","Data":"83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8"} Jun 05 13:42:31.703280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.702939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qj4rl" event={"ID":"31ef2616-f1cf-400a-b14c-3550dfa5774a","Type":"ContainerDied","Data":"6713ecaf8af0cb5610991608ffb65aef5fb90f5e55fb720321cf0bda5449a564"} Jun 05 13:42:31.703280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.702956 2579 scope.go:117] "RemoveContainer" containerID="83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8" Jun 05 13:42:31.711231 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.711179 2579 scope.go:117] "RemoveContainer" containerID="83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8" Jun 05 13:42:31.711456 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:42:31.711436 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8\": container with ID starting with 83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8 not found: ID does not exist" containerID="83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8" Jun 05 13:42:31.711536 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.711464 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8"} err="failed to get container status \"83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8\": rpc error: code = NotFound desc = could not find container \"83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8\": container with ID starting with 83ae9cafefadabae95a8fcda630e2d8c391a0a9dcd5c5fae94cc6b0f1b5c1bc8 not found: ID does not exist" Jun 05 13:42:31.719611 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.719590 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qj4rl"] Jun 05 13:42:31.723450 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:31.723431 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qj4rl"] Jun 05 13:42:33.619668 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:33.619594 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ef2616-f1cf-400a-b14c-3550dfa5774a" path="/var/lib/kubelet/pods/31ef2616-f1cf-400a-b14c-3550dfa5774a/volumes" Jun 05 13:42:39.696171 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:39.696139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-czwmv" Jun 05 13:42:41.231534 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:41.231495 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:42:43.633375 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:43.633344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:42:44.058830 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:44.058790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:42:53.140389 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:53.140355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:42:53.239622 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:53.239592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:42:53.401643 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:42:53.401563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:16.786623 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:16.786580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:16.888338 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:16.888300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:46.309235 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.309183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:46.537306 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.537277 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hrsqp"] Jun 05 13:43:46.537614 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.537602 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ef2616-f1cf-400a-b14c-3550dfa5774a" containerName="authorino" Jun 05 13:43:46.537671 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.537615 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ef2616-f1cf-400a-b14c-3550dfa5774a" containerName="authorino" Jun 05 13:43:46.537712 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.537670 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ef2616-f1cf-400a-b14c-3550dfa5774a" containerName="authorino" Jun 05 13:43:46.539495 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.539478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:46.545291 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.545265 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hrsqp"] Jun 05 13:43:46.577716 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.577650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6shfm\" (UniqueName: \"kubernetes.io/projected/a4db7342-e358-4def-8316-aa3bd395d781-kube-api-access-6shfm\") pod \"authorino-5d4b67c446-hrsqp\" (UID: \"a4db7342-e358-4def-8316-aa3bd395d781\") " pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:46.678538 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.678506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6shfm\" (UniqueName: \"kubernetes.io/projected/a4db7342-e358-4def-8316-aa3bd395d781-kube-api-access-6shfm\") pod \"authorino-5d4b67c446-hrsqp\" (UID: \"a4db7342-e358-4def-8316-aa3bd395d781\") " pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:46.686373 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.686346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6shfm\" (UniqueName: \"kubernetes.io/projected/a4db7342-e358-4def-8316-aa3bd395d781-kube-api-access-6shfm\") pod \"authorino-5d4b67c446-hrsqp\" (UID: \"a4db7342-e358-4def-8316-aa3bd395d781\") " pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:46.706865 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.706836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:46.765501 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.765475 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hrsqp"] Jun 05 13:43:46.765723 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.765710 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:46.794995 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.794961 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b88dffbbc-pz8bt"] Jun 05 13:43:46.797500 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.797483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:46.805491 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.805463 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b88dffbbc-pz8bt"] Jun 05 13:43:46.879477 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.879449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbjz\" (UniqueName: \"kubernetes.io/projected/807dfe93-9bd7-49a4-8b37-1195c5a13ba3-kube-api-access-mbbjz\") pod \"authorino-5b88dffbbc-pz8bt\" (UID: \"807dfe93-9bd7-49a4-8b37-1195c5a13ba3\") " pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:46.904889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.904866 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hrsqp"] Jun 05 13:43:46.907001 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:43:46.906971 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4db7342_e358_4def_8316_aa3bd395d781.slice/crio-9cf72bc087ebaf4f9c37f3e49d7dcd4df07e152e7ee6fb9783692a5a5c047a2a WatchSource:0}: Error finding container 9cf72bc087ebaf4f9c37f3e49d7dcd4df07e152e7ee6fb9783692a5a5c047a2a: Status 404 returned error can't find the container with id 9cf72bc087ebaf4f9c37f3e49d7dcd4df07e152e7ee6fb9783692a5a5c047a2a Jun 05 13:43:46.908409 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.908392 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:43:46.971817 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.971789 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b88dffbbc-pz8bt"] Jun 05 13:43:46.972042 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:43:46.972024 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mbbjz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" podUID="807dfe93-9bd7-49a4-8b37-1195c5a13ba3" Jun 05 13:43:46.980457 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.980432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbjz\" (UniqueName: \"kubernetes.io/projected/807dfe93-9bd7-49a4-8b37-1195c5a13ba3-kube-api-access-mbbjz\") pod \"authorino-5b88dffbbc-pz8bt\" (UID: \"807dfe93-9bd7-49a4-8b37-1195c5a13ba3\") " pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:46.991914 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:46.991891 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbjz\" (UniqueName: \"kubernetes.io/projected/807dfe93-9bd7-49a4-8b37-1195c5a13ba3-kube-api-access-mbbjz\") pod \"authorino-5b88dffbbc-pz8bt\" (UID: \"807dfe93-9bd7-49a4-8b37-1195c5a13ba3\") " pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:47.002667 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.002647 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-868cb74487-xbtc6"] Jun 05 13:43:47.004857 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.004841 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.007614 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.007598 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 13:43:47.013938 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.013917 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-868cb74487-xbtc6"] Jun 05 13:43:47.038394 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.038366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" event={"ID":"a4db7342-e358-4def-8316-aa3bd395d781","Type":"ContainerStarted","Data":"9cf72bc087ebaf4f9c37f3e49d7dcd4df07e152e7ee6fb9783692a5a5c047a2a"} Jun 05 13:43:47.038394 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.038388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:47.043540 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.043523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:47.081610 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.081592 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbbjz\" (UniqueName: \"kubernetes.io/projected/807dfe93-9bd7-49a4-8b37-1195c5a13ba3-kube-api-access-mbbjz\") pod \"807dfe93-9bd7-49a4-8b37-1195c5a13ba3\" (UID: \"807dfe93-9bd7-49a4-8b37-1195c5a13ba3\") " Jun 05 13:43:47.081713 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.081693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4afae0c3-c88d-4f64-98e9-f7aeffe809be-tls-cert\") pod \"authorino-868cb74487-xbtc6\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.081786 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.081769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvhd\" (UniqueName: \"kubernetes.io/projected/4afae0c3-c88d-4f64-98e9-f7aeffe809be-kube-api-access-zvvhd\") pod \"authorino-868cb74487-xbtc6\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.083629 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.083608 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807dfe93-9bd7-49a4-8b37-1195c5a13ba3-kube-api-access-mbbjz" (OuterVolumeSpecName: "kube-api-access-mbbjz") pod "807dfe93-9bd7-49a4-8b37-1195c5a13ba3" (UID: "807dfe93-9bd7-49a4-8b37-1195c5a13ba3"). InnerVolumeSpecName "kube-api-access-mbbjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:43:47.182890 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.182860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4afae0c3-c88d-4f64-98e9-f7aeffe809be-tls-cert\") pod \"authorino-868cb74487-xbtc6\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.183045 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.182912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvhd\" (UniqueName: \"kubernetes.io/projected/4afae0c3-c88d-4f64-98e9-f7aeffe809be-kube-api-access-zvvhd\") pod \"authorino-868cb74487-xbtc6\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.183045 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.182937 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbbjz\" (UniqueName: \"kubernetes.io/projected/807dfe93-9bd7-49a4-8b37-1195c5a13ba3-kube-api-access-mbbjz\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:43:47.185280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.185249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4afae0c3-c88d-4f64-98e9-f7aeffe809be-tls-cert\") pod \"authorino-868cb74487-xbtc6\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.190310 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.190287 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvhd\" (UniqueName: \"kubernetes.io/projected/4afae0c3-c88d-4f64-98e9-f7aeffe809be-kube-api-access-zvvhd\") pod \"authorino-868cb74487-xbtc6\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.315071 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.315044 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:43:47.451991 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:47.451967 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-868cb74487-xbtc6"] Jun 05 13:43:47.453793 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:43:47.453769 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4afae0c3_c88d_4f64_98e9_f7aeffe809be.slice/crio-da20640f168c4c0f82e00b89d71feac013cd29912db2441e440d4ad992e35b3a WatchSource:0}: Error finding container da20640f168c4c0f82e00b89d71feac013cd29912db2441e440d4ad992e35b3a: Status 404 returned error can't find the container with id da20640f168c4c0f82e00b89d71feac013cd29912db2441e440d4ad992e35b3a Jun 05 13:43:48.044434 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.044337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868cb74487-xbtc6" event={"ID":"4afae0c3-c88d-4f64-98e9-f7aeffe809be","Type":"ContainerStarted","Data":"86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da"} Jun 05 13:43:48.044434 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.044386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868cb74487-xbtc6" event={"ID":"4afae0c3-c88d-4f64-98e9-f7aeffe809be","Type":"ContainerStarted","Data":"da20640f168c4c0f82e00b89d71feac013cd29912db2441e440d4ad992e35b3a"} Jun 05 13:43:48.045786 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.045760 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" podUID="a4db7342-e358-4def-8316-aa3bd395d781" containerName="authorino" containerID="cri-o://ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff" gracePeriod=30 Jun 05 13:43:48.045936 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.045765 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b88dffbbc-pz8bt" Jun 05 13:43:48.045936 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.045766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" event={"ID":"a4db7342-e358-4def-8316-aa3bd395d781","Type":"ContainerStarted","Data":"ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff"} Jun 05 13:43:48.060862 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.060817 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-868cb74487-xbtc6" podStartSLOduration=1.800201576 podStartE2EDuration="2.060801255s" totalImagesPullingTime="260.599679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:43:48.059446511 +0000 UTC m=+1136.874396172" watchObservedRunningTime="2026-06-05 13:43:48.060801255 +0000 UTC m=+1136.875750911" Jun 05 13:43:48.074896 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.074858 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" podStartSLOduration=1.6986045 podStartE2EDuration="2.074843464s" totalImagesPullingTime="376.238964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:43:48.074421722 +0000 UTC m=+1136.889371391" watchObservedRunningTime="2026-06-05 13:43:48.074843464 +0000 UTC m=+1136.889793120" Jun 05 13:43:48.090827 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.090798 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lgzkt"] Jun 05 13:43:48.091096 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.091069 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lgzkt" podUID="1067ea7c-8088-41b4-88e0-5869400ac1ba" containerName="authorino" containerID="cri-o://4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8" gracePeriod=30 Jun 05 13:43:48.105058 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.105025 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b88dffbbc-pz8bt"] Jun 05 13:43:48.108624 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.108595 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b88dffbbc-pz8bt"] Jun 05 13:43:48.332157 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.332133 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:48.361242 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.361201 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:43:48.393115 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.393086 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6shfm\" (UniqueName: \"kubernetes.io/projected/a4db7342-e358-4def-8316-aa3bd395d781-kube-api-access-6shfm\") pod \"a4db7342-e358-4def-8316-aa3bd395d781\" (UID: \"a4db7342-e358-4def-8316-aa3bd395d781\") " Jun 05 13:43:48.393304 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.393127 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/1067ea7c-8088-41b4-88e0-5869400ac1ba-kube-api-access-l6ggx\") pod \"1067ea7c-8088-41b4-88e0-5869400ac1ba\" (UID: \"1067ea7c-8088-41b4-88e0-5869400ac1ba\") " Jun 05 13:43:48.395139 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.395111 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1067ea7c-8088-41b4-88e0-5869400ac1ba-kube-api-access-l6ggx" (OuterVolumeSpecName: "kube-api-access-l6ggx") pod "1067ea7c-8088-41b4-88e0-5869400ac1ba" (UID: "1067ea7c-8088-41b4-88e0-5869400ac1ba"). InnerVolumeSpecName "kube-api-access-l6ggx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:43:48.395320 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.395149 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4db7342-e358-4def-8316-aa3bd395d781-kube-api-access-6shfm" (OuterVolumeSpecName: "kube-api-access-6shfm") pod "a4db7342-e358-4def-8316-aa3bd395d781" (UID: "a4db7342-e358-4def-8316-aa3bd395d781"). InnerVolumeSpecName "kube-api-access-6shfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:43:48.494479 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.494447 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6shfm\" (UniqueName: \"kubernetes.io/projected/a4db7342-e358-4def-8316-aa3bd395d781-kube-api-access-6shfm\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:43:48.494479 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:48.494473 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/1067ea7c-8088-41b4-88e0-5869400ac1ba-kube-api-access-l6ggx\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:43:49.054249 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.054140 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4db7342-e358-4def-8316-aa3bd395d781" containerID="ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff" exitCode=0 Jun 05 13:43:49.054249 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.054191 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" Jun 05 13:43:49.054249 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.054241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" event={"ID":"a4db7342-e358-4def-8316-aa3bd395d781","Type":"ContainerDied","Data":"ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff"} Jun 05 13:43:49.054539 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.054282 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hrsqp" event={"ID":"a4db7342-e358-4def-8316-aa3bd395d781","Type":"ContainerDied","Data":"9cf72bc087ebaf4f9c37f3e49d7dcd4df07e152e7ee6fb9783692a5a5c047a2a"} Jun 05 13:43:49.054539 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.054304 2579 scope.go:117] "RemoveContainer" containerID="ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff" Jun 05 13:43:49.055765 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.055746 2579 generic.go:356] "Generic (PLEG): container finished" podID="1067ea7c-8088-41b4-88e0-5869400ac1ba" containerID="4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8" exitCode=0 Jun 05 13:43:49.055841 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.055788 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lgzkt" Jun 05 13:43:49.055841 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.055826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lgzkt" event={"ID":"1067ea7c-8088-41b4-88e0-5869400ac1ba","Type":"ContainerDied","Data":"4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8"} Jun 05 13:43:49.055927 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.055859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lgzkt" event={"ID":"1067ea7c-8088-41b4-88e0-5869400ac1ba","Type":"ContainerDied","Data":"bf105822f997bd8c52f5df27045c9fe1960d8582e2042c01798bcc97570607e5"} Jun 05 13:43:49.062561 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.062544 2579 scope.go:117] "RemoveContainer" containerID="ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff" Jun 05 13:43:49.062831 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:43:49.062809 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff\": container with ID starting with ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff not found: ID does not exist" containerID="ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff" Jun 05 13:43:49.062916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.062841 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff"} err="failed to get container status \"ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff\": rpc error: code = NotFound desc = could not find container \"ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff\": container with ID starting with ba7e02a0533cbd9cdadd3fdf378de9a245d434a6bec4bf3c173a6c1669bea6ff not found: ID does not exist" Jun 05 13:43:49.062916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.062858 2579 scope.go:117] "RemoveContainer" containerID="4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8" Jun 05 13:43:49.070999 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.070982 2579 scope.go:117] "RemoveContainer" containerID="4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8" Jun 05 13:43:49.071241 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:43:49.071212 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8\": container with ID starting with 4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8 not found: ID does not exist" containerID="4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8" Jun 05 13:43:49.071288 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.071248 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8"} err="failed to get container status \"4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8\": rpc error: code = NotFound desc = could not find container \"4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8\": container with ID starting with 4ff3ffa732c4accdb8069cbf9ed5ca50e1bc7b70911b92beb92045bca1b54bb8 not found: ID does not exist" Jun 05 13:43:49.078122 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.078098 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hrsqp"] Jun 05 13:43:49.084052 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.084025 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hrsqp"] Jun 05 13:43:49.093172 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.093150 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lgzkt"] Jun 05 13:43:49.097000 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.096981 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lgzkt"] Jun 05 13:43:49.620902 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.620873 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1067ea7c-8088-41b4-88e0-5869400ac1ba" path="/var/lib/kubelet/pods/1067ea7c-8088-41b4-88e0-5869400ac1ba/volumes" Jun 05 13:43:49.621271 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.621175 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="807dfe93-9bd7-49a4-8b37-1195c5a13ba3" path="/var/lib/kubelet/pods/807dfe93-9bd7-49a4-8b37-1195c5a13ba3/volumes" Jun 05 13:43:49.621394 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:49.621382 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4db7342-e358-4def-8316-aa3bd395d781" path="/var/lib/kubelet/pods/a4db7342-e358-4def-8316-aa3bd395d781/volumes" Jun 05 13:43:51.674397 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:51.674368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:51.775209 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:51.775173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:51.940797 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:51.940749 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:52.034332 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:52.034296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:54.908133 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:54.908074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:43:55.004889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:43:55.004859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:23.543853 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:23.543813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:23.644015 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:23.643980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:26.387582 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:26.387548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:26.763419 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:26.763385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:26.861152 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:26.861122 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:26.934833 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:26.934771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:44:26.954881 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:26.954852 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:44:51.642020 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:51.641985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:44:51.642532 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:44:51.642514 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:45:23.598681 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:23.598633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:23.648419 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:23.648385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:26.783416 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783382 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54f8fbd99-lwjjq"] Jun 05 13:45:26.783779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783704 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1067ea7c-8088-41b4-88e0-5869400ac1ba" containerName="authorino" Jun 05 13:45:26.783779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783715 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1067ea7c-8088-41b4-88e0-5869400ac1ba" containerName="authorino" Jun 05 13:45:26.783779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783729 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4db7342-e358-4def-8316-aa3bd395d781" containerName="authorino" Jun 05 13:45:26.783779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783735 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4db7342-e358-4def-8316-aa3bd395d781" containerName="authorino" Jun 05 13:45:26.783925 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783783 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4db7342-e358-4def-8316-aa3bd395d781" containerName="authorino" Jun 05 13:45:26.783925 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.783804 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1067ea7c-8088-41b4-88e0-5869400ac1ba" containerName="authorino" Jun 05 13:45:26.785701 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.785684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:26.788440 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.788423 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 05 13:45:26.794979 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.794954 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f8fbd99-lwjjq"] Jun 05 13:45:26.924874 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.924841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c1bbd0cf-c0de-4372-86c8-37c72158b091-oidc-ca\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:26.925067 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.924915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmp5p\" (UniqueName: \"kubernetes.io/projected/c1bbd0cf-c0de-4372-86c8-37c72158b091-kube-api-access-gmp5p\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:26.925067 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:26.924945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1bbd0cf-c0de-4372-86c8-37c72158b091-tls-cert\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.026133 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.026093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c1bbd0cf-c0de-4372-86c8-37c72158b091-oidc-ca\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.026337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.026169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmp5p\" (UniqueName: \"kubernetes.io/projected/c1bbd0cf-c0de-4372-86c8-37c72158b091-kube-api-access-gmp5p\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.026337 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.026194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1bbd0cf-c0de-4372-86c8-37c72158b091-tls-cert\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.026897 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.026874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c1bbd0cf-c0de-4372-86c8-37c72158b091-oidc-ca\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.028582 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.028563 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1bbd0cf-c0de-4372-86c8-37c72158b091-tls-cert\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.034814 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.034754 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmp5p\" (UniqueName: \"kubernetes.io/projected/c1bbd0cf-c0de-4372-86c8-37c72158b091-kube-api-access-gmp5p\") pod \"authorino-54f8fbd99-lwjjq\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.095403 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.095370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:45:27.228902 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.228878 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f8fbd99-lwjjq"] Jun 05 13:45:27.231149 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:45:27.231117 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1bbd0cf_c0de_4372_86c8_37c72158b091.slice/crio-3f76863fe0404a2db2d1a8f4cb450c1ac3deb277687299a7efd828888e3e9005 WatchSource:0}: Error finding container 3f76863fe0404a2db2d1a8f4cb450c1ac3deb277687299a7efd828888e3e9005: Status 404 returned error can't find the container with id 3f76863fe0404a2db2d1a8f4cb450c1ac3deb277687299a7efd828888e3e9005 Jun 05 13:45:27.504694 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:27.504653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" event={"ID":"c1bbd0cf-c0de-4372-86c8-37c72158b091","Type":"ContainerStarted","Data":"3f76863fe0404a2db2d1a8f4cb450c1ac3deb277687299a7efd828888e3e9005"} Jun 05 13:45:28.512406 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.512364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" event={"ID":"c1bbd0cf-c0de-4372-86c8-37c72158b091","Type":"ContainerStarted","Data":"85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a"} Jun 05 13:45:28.537625 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.537569 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" podStartSLOduration=2.069349773 podStartE2EDuration="2.537551602s" totalImagesPullingTime="468.201829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:45:28.537030701 +0000 UTC m=+1237.351980359" watchObservedRunningTime="2026-06-05 13:45:28.537551602 +0000 UTC m=+1237.352501258" Jun 05 13:45:28.563814 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.563766 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-868cb74487-xbtc6"] Jun 05 13:45:28.564046 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.564017 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-868cb74487-xbtc6" podUID="4afae0c3-c88d-4f64-98e9-f7aeffe809be" containerName="authorino" containerID="cri-o://86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da" gracePeriod=30 Jun 05 13:45:28.815563 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.815533 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:45:28.945994 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.945957 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvvhd\" (UniqueName: \"kubernetes.io/projected/4afae0c3-c88d-4f64-98e9-f7aeffe809be-kube-api-access-zvvhd\") pod \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " Jun 05 13:45:28.946169 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.946017 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4afae0c3-c88d-4f64-98e9-f7aeffe809be-tls-cert\") pod \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\" (UID: \"4afae0c3-c88d-4f64-98e9-f7aeffe809be\") " Jun 05 13:45:28.948227 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.948180 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afae0c3-c88d-4f64-98e9-f7aeffe809be-kube-api-access-zvvhd" (OuterVolumeSpecName: "kube-api-access-zvvhd") pod "4afae0c3-c88d-4f64-98e9-f7aeffe809be" (UID: "4afae0c3-c88d-4f64-98e9-f7aeffe809be"). InnerVolumeSpecName "kube-api-access-zvvhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:45:28.956169 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.956138 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4afae0c3-c88d-4f64-98e9-f7aeffe809be-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4afae0c3-c88d-4f64-98e9-f7aeffe809be" (UID: "4afae0c3-c88d-4f64-98e9-f7aeffe809be"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:45:28.988623 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:28.988587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:29.047204 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.047130 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvvhd\" (UniqueName: \"kubernetes.io/projected/4afae0c3-c88d-4f64-98e9-f7aeffe809be-kube-api-access-zvvhd\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:45:29.047204 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.047158 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4afae0c3-c88d-4f64-98e9-f7aeffe809be-tls-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:45:29.089173 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.089136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:29.518431 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.518399 2579 generic.go:356] "Generic (PLEG): container finished" podID="4afae0c3-c88d-4f64-98e9-f7aeffe809be" containerID="86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da" exitCode=0 Jun 05 13:45:29.518889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.518448 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868cb74487-xbtc6" Jun 05 13:45:29.518889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.518489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868cb74487-xbtc6" event={"ID":"4afae0c3-c88d-4f64-98e9-f7aeffe809be","Type":"ContainerDied","Data":"86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da"} Jun 05 13:45:29.518889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.518536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868cb74487-xbtc6" event={"ID":"4afae0c3-c88d-4f64-98e9-f7aeffe809be","Type":"ContainerDied","Data":"da20640f168c4c0f82e00b89d71feac013cd29912db2441e440d4ad992e35b3a"} Jun 05 13:45:29.518889 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.518564 2579 scope.go:117] "RemoveContainer" containerID="86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da" Jun 05 13:45:29.527677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.527654 2579 scope.go:117] "RemoveContainer" containerID="86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da" Jun 05 13:45:29.527914 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:45:29.527889 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da\": container with ID starting with 86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da not found: ID does not exist" containerID="86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da" Jun 05 13:45:29.527983 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.527921 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da"} err="failed to get container status \"86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da\": rpc error: code = NotFound desc = could not find container \"86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da\": container with ID starting with 86831c2dd9433009a348967ea6ce0f602b83a4b6a76d574ff46f26cf59f396da not found: ID does not exist" Jun 05 13:45:29.543817 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.543795 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-868cb74487-xbtc6"] Jun 05 13:45:29.547688 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.547670 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-868cb74487-xbtc6"] Jun 05 13:45:29.619994 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:29.619969 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4afae0c3-c88d-4f64-98e9-f7aeffe809be" path="/var/lib/kubelet/pods/4afae0c3-c88d-4f64-98e9-f7aeffe809be/volumes" Jun 05 13:45:30.814775 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:30.814729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:30.866986 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:30.866959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:37.152779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:37.152674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:37.595761 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:37.595731 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:45:55.049474 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:55.049437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:55.096953 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:55.096919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:55.157131 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:55.157099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:56.164741 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:56.164710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:56.266646 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:56.266592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:56.537436 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:56.537388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:45:56.637377 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:45:56.637342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:05.427176 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:05.427133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:05.909246 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:05.909142 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:46:18.466847 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:18.466811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:19.001421 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:19.001383 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:46:19.631597 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:19.631561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:19.686378 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:19.686348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:19.740732 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:19.740705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:39.574234 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.574187 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9"] Jun 05 13:46:39.574677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.574520 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4afae0c3-c88d-4f64-98e9-f7aeffe809be" containerName="authorino" Jun 05 13:46:39.574677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.574532 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4afae0c3-c88d-4f64-98e9-f7aeffe809be" containerName="authorino" Jun 05 13:46:39.574677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.574603 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4afae0c3-c88d-4f64-98e9-f7aeffe809be" containerName="authorino" Jun 05 13:46:39.577503 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.577486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.580512 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.580489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 13:46:39.581985 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.581957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 13:46:39.581985 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.581981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 13:46:39.582134 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.581961 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sxkzt\"" Jun 05 13:46:39.589935 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.589915 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9"] Jun 05 13:46:39.603878 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.603855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:39.641153 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.641130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.641265 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.641160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15b4e8df-af71-4586-8466-d2066e038ea9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.641265 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.641195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.641361 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.641277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4t6x\" (UniqueName: \"kubernetes.io/projected/15b4e8df-af71-4586-8466-d2066e038ea9-kube-api-access-s4t6x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.641361 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.641306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.641361 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.641334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742319 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742319 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4t6x\" (UniqueName: \"kubernetes.io/projected/15b4e8df-af71-4586-8466-d2066e038ea9-kube-api-access-s4t6x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742511 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742511 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742511 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742511 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15b4e8df-af71-4586-8466-d2066e038ea9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742854 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742832 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742927 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742881 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.742988 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.742973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.744654 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.744629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15b4e8df-af71-4586-8466-d2066e038ea9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.744902 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.744885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15b4e8df-af71-4586-8466-d2066e038ea9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.750011 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.749982 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4t6x\" (UniqueName: \"kubernetes.io/projected/15b4e8df-af71-4586-8466-d2066e038ea9-kube-api-access-s4t6x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9\" (UID: \"15b4e8df-af71-4586-8466-d2066e038ea9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:39.888177 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:39.888102 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:40.025375 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:40.025343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9"] Jun 05 13:46:40.027828 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:46:40.027803 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b4e8df_af71_4586_8466_d2066e038ea9.slice/crio-b61403c69e393deb8c70be78d282899645f66a856dd68c1e2271a43542cfbd86 WatchSource:0}: Error finding container b61403c69e393deb8c70be78d282899645f66a856dd68c1e2271a43542cfbd86: Status 404 returned error can't find the container with id b61403c69e393deb8c70be78d282899645f66a856dd68c1e2271a43542cfbd86 Jun 05 13:46:40.587428 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:40.587395 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:46:40.843041 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:40.842955 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" event={"ID":"15b4e8df-af71-4586-8466-d2066e038ea9","Type":"ContainerStarted","Data":"b61403c69e393deb8c70be78d282899645f66a856dd68c1e2271a43542cfbd86"} Jun 05 13:46:43.311702 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:43.311667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:44.593641 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:44.593562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:46:44.869802 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:44.869716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" event={"ID":"15b4e8df-af71-4586-8466-d2066e038ea9","Type":"ContainerStarted","Data":"4ded4525d7bdf9be03acbd8d67b15babfd2de72de28bb6c5dfaa295538f42a09"} Jun 05 13:46:45.875481 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:45.875449 2579 generic.go:356] "Generic (PLEG): container finished" podID="15b4e8df-af71-4586-8466-d2066e038ea9" containerID="4ded4525d7bdf9be03acbd8d67b15babfd2de72de28bb6c5dfaa295538f42a09" exitCode=0 Jun 05 13:46:45.875916 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:45.875522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" event={"ID":"15b4e8df-af71-4586-8466-d2066e038ea9","Type":"ContainerDied","Data":"4ded4525d7bdf9be03acbd8d67b15babfd2de72de28bb6c5dfaa295538f42a09"} Jun 05 13:46:47.052772 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:47.052738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:46:47.886939 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:47.886909 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" event={"ID":"15b4e8df-af71-4586-8466-d2066e038ea9","Type":"ContainerStarted","Data":"95334067d6c6f5e4de39fcffdd00f6e84afa848784400bc02b718f2dec66ba93"} Jun 05 13:46:47.905894 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:47.905848 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" podStartSLOduration=2.146668749 podStartE2EDuration="8.905833575s" totalImagesPullingTime="5.398619343s" totalInitContainerRuntime="1.360545483s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:46:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:46:47.904387458 +0000 UTC m=+1316.719337113" watchObservedRunningTime="2026-06-05 13:46:47.905833575 +0000 UTC m=+1316.720783231" Jun 05 13:46:49.888630 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:49.888581 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:49.889089 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:49.888653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:49.901825 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:49.901794 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:50.912957 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:50.912926 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9" Jun 05 13:46:52.484565 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:46:52.484529 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:47:01.127483 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:01.127441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:47:19.737201 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:19.737169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:47:37.825933 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:37.825899 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8c799864b-2kptc"] Jun 05 13:47:37.829185 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:37.829168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:37.836781 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:37.836758 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8c799864b-2kptc"] Jun 05 13:47:37.928368 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:37.928331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-oidc-ca\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:37.928521 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:37.928382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-tls-cert\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:37.928521 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:37.928471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9nt2\" (UniqueName: \"kubernetes.io/projected/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-kube-api-access-x9nt2\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.029663 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.029630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-tls-cert\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.029820 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.029687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9nt2\" (UniqueName: \"kubernetes.io/projected/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-kube-api-access-x9nt2\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.029820 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.029726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-oidc-ca\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.030364 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.030346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-oidc-ca\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.031989 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.031969 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-tls-cert\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.037257 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.037237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9nt2\" (UniqueName: \"kubernetes.io/projected/29e2bf6a-f13f-490c-832e-0f6ebd78a7bf-kube-api-access-x9nt2\") pod \"authorino-8c799864b-2kptc\" (UID: \"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf\") " pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.139072 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.139000 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8c799864b-2kptc" Jun 05 13:47:38.270463 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.270434 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8c799864b-2kptc"] Jun 05 13:47:38.273175 ip-10-0-138-68 kubenswrapper[2579]: W0605 13:47:38.273135 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29e2bf6a_f13f_490c_832e_0f6ebd78a7bf.slice/crio-50e0432d71fac941aaff5b2b13f8cbb57aad648a7c5fb14cdb4561b4ae77829a WatchSource:0}: Error finding container 50e0432d71fac941aaff5b2b13f8cbb57aad648a7c5fb14cdb4561b4ae77829a: Status 404 returned error can't find the container with id 50e0432d71fac941aaff5b2b13f8cbb57aad648a7c5fb14cdb4561b4ae77829a Jun 05 13:47:38.312468 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.312441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:47:38.413706 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:38.413634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:47:39.127676 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.127578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8c799864b-2kptc" event={"ID":"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf","Type":"ContainerStarted","Data":"eb9f1ec4b74f8ae683b23edb05acfee68ba351b86f6c5c84f3c438daca532da0"} Jun 05 13:47:39.127676 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.127627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8c799864b-2kptc" event={"ID":"29e2bf6a-f13f-490c-832e-0f6ebd78a7bf","Type":"ContainerStarted","Data":"50e0432d71fac941aaff5b2b13f8cbb57aad648a7c5fb14cdb4561b4ae77829a"} Jun 05 13:47:39.160703 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.160645 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8c799864b-2kptc" podStartSLOduration=1.7012743449999999 podStartE2EDuration="2.16062192s" totalImagesPullingTime="459.347575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:47:39.159285222 +0000 UTC m=+1367.974234879" watchObservedRunningTime="2026-06-05 13:47:39.16062192 +0000 UTC m=+1367.975571576" Jun 05 13:47:39.197000 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.196961 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54f8fbd99-lwjjq"] Jun 05 13:47:39.197226 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.197188 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" podUID="c1bbd0cf-c0de-4372-86c8-37c72158b091" containerName="authorino" containerID="cri-o://85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a" gracePeriod=30 Jun 05 13:47:39.419800 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.419680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:47:39.471595 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.471569 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:47:39.536924 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.536890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:47:39.542970 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.542941 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmp5p\" (UniqueName: \"kubernetes.io/projected/c1bbd0cf-c0de-4372-86c8-37c72158b091-kube-api-access-gmp5p\") pod \"c1bbd0cf-c0de-4372-86c8-37c72158b091\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " Jun 05 13:47:39.543128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.542991 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1bbd0cf-c0de-4372-86c8-37c72158b091-tls-cert\") pod \"c1bbd0cf-c0de-4372-86c8-37c72158b091\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " Jun 05 13:47:39.543128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.543035 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c1bbd0cf-c0de-4372-86c8-37c72158b091-oidc-ca\") pod \"c1bbd0cf-c0de-4372-86c8-37c72158b091\" (UID: \"c1bbd0cf-c0de-4372-86c8-37c72158b091\") " Jun 05 13:47:39.545118 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.545086 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bbd0cf-c0de-4372-86c8-37c72158b091-kube-api-access-gmp5p" (OuterVolumeSpecName: "kube-api-access-gmp5p") pod "c1bbd0cf-c0de-4372-86c8-37c72158b091" (UID: "c1bbd0cf-c0de-4372-86c8-37c72158b091"). InnerVolumeSpecName "kube-api-access-gmp5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:47:39.547805 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.547781 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1bbd0cf-c0de-4372-86c8-37c72158b091-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c1bbd0cf-c0de-4372-86c8-37c72158b091" (UID: "c1bbd0cf-c0de-4372-86c8-37c72158b091"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:47:39.552423 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.552401 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1bbd0cf-c0de-4372-86c8-37c72158b091-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c1bbd0cf-c0de-4372-86c8-37c72158b091" (UID: "c1bbd0cf-c0de-4372-86c8-37c72158b091"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:47:39.644107 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.644075 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmp5p\" (UniqueName: \"kubernetes.io/projected/c1bbd0cf-c0de-4372-86c8-37c72158b091-kube-api-access-gmp5p\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:47:39.644107 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.644103 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1bbd0cf-c0de-4372-86c8-37c72158b091-tls-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:47:39.644107 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:39.644113 2579 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c1bbd0cf-c0de-4372-86c8-37c72158b091-oidc-ca\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 13:47:40.133347 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.133316 2579 generic.go:356] "Generic (PLEG): container finished" podID="c1bbd0cf-c0de-4372-86c8-37c72158b091" containerID="85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a" exitCode=0 Jun 05 13:47:40.133789 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.133368 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" Jun 05 13:47:40.133789 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.133394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" event={"ID":"c1bbd0cf-c0de-4372-86c8-37c72158b091","Type":"ContainerDied","Data":"85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a"} Jun 05 13:47:40.133789 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.133432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8fbd99-lwjjq" event={"ID":"c1bbd0cf-c0de-4372-86c8-37c72158b091","Type":"ContainerDied","Data":"3f76863fe0404a2db2d1a8f4cb450c1ac3deb277687299a7efd828888e3e9005"} Jun 05 13:47:40.133789 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.133449 2579 scope.go:117] "RemoveContainer" containerID="85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a" Jun 05 13:47:40.141966 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.141944 2579 scope.go:117] "RemoveContainer" containerID="85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a" Jun 05 13:47:40.142239 ip-10-0-138-68 kubenswrapper[2579]: E0605 13:47:40.142202 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a\": container with ID starting with 85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a not found: ID does not exist" containerID="85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a" Jun 05 13:47:40.142296 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.142251 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a"} err="failed to get container status \"85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a\": rpc error: code = NotFound desc = could not find container \"85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a\": container with ID starting with 85ce18a9399c9d4b0a5399fe4a3602a9681f966bf738e75aabdd683bb7279b3a not found: ID does not exist" Jun 05 13:47:40.161344 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.161320 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54f8fbd99-lwjjq"] Jun 05 13:47:40.177471 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:40.177439 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54f8fbd99-lwjjq"] Jun 05 13:47:41.621520 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:41.621492 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bbd0cf-c0de-4372-86c8-37c72158b091" path="/var/lib/kubelet/pods/c1bbd0cf-c0de-4372-86c8-37c72158b091/volumes" Jun 05 13:47:49.730449 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:47:49.730410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:48:02.697189 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:02.697135 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:48:09.417256 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:09.416013 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:48:20.596280 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:20.596242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:48:29.198537 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:29.198493 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:48:39.800734 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:39.800650 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:48:48.598963 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:48.598923 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:48:59.792774 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:48:59.792734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:49:05.532445 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:05.532409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:49:07.586313 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:07.586278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:49:49.347174 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:49.347141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:49:49.446962 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:49.446926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:49:51.667259 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:51.667211 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:49:51.668477 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:51.668456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:49:57.850098 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:49:57.850063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:50:03.485811 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:03.485736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:50:03.549251 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:03.549198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:50:12.996441 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:12.996403 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:50:30.296962 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:30.296928 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:50:35.642314 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:35.642274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:50:35.742507 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:35.742475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:50:59.685695 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:50:59.685661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:05.595123 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:05.595092 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:05.660210 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:05.660180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:05.756249 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:05.756208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:05.854411 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:05.854343 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:05.965133 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:05.965103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:06.064586 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:06.064557 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:07.819632 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:07.819597 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:51:22.496360 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:22.496327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:22.596386 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:22.596350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:22.716994 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:22.716959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:26.188548 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:26.188515 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:51:28.311231 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:28.311183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:28.411135 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:28.411111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:36.632331 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:36.632230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:36.721793 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:36.721762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:36.822076 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:36.822039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:39.896359 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:39.896326 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:51:53.262830 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:53.262795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:53.377125 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:53.377095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:53.480997 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:53.480969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:54.891179 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:54.891145 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:51:59.367186 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:59.367134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:51:59.424882 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:51:59.424835 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:21.911696 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:21.911658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:22.011471 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:22.011435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:22.143773 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:22.143739 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:27.879105 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:27.879078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:27.940806 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:27.940772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:28.009349 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:28.009317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:28.109406 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:28.109381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:28.213128 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:28.213101 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:28.772471 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:28.772443 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:33.928824 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:33.928786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:52:34.028952 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:52:34.028914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:53:02.492629 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:53:02.492591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:53:11.803583 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:53:11.803533 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:53:28.304487 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:53:28.304448 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:53:35.097084 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:53:35.097044 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:53:53.397883 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:53:53.397842 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:54:00.404297 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:00.404264 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:54:34.387161 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:34.387061 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:54:42.691169 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:42.691130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:54:50.990636 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:50.990596 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:54:51.694290 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:51.694265 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:54:51.696677 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:51.696656 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:54:58.994260 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:54:58.994199 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:55:07.889395 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:55:07.889358 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:55:15.488576 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:55:15.488533 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:55:21.886021 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:55:21.885982 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:55:27.791531 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:55:27.791494 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:55:39.190606 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:55:39.190557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:56:25.992050 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:56:25.992010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:56:34.188412 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:56:34.188368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:56:42.096576 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:56:42.096541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:56:47.689816 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:56:47.689779 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:56:56.589581 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:56:56.589541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:05.795779 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:05.795742 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:14.787054 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:14.787008 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:21.201850 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:21.201822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:31.384526 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:31.384491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:40.902161 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:40.902082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:49.496358 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:49.496322 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:57:56.599297 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:57:56.599256 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:03.688505 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:03.688475 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:09.782565 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:09.782535 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:15.492393 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:15.492346 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:24.692188 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:24.692149 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:32.790675 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:32.790636 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:41.486310 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:41.486274 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:58:50.488289 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:58:50.488244 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 13:59:11.134136 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:11.134055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:59:12.661580 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:12.661544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:59:24.582698 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:24.582650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:59:24.876911 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:24.876829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:59:24.931902 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:24.931871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 13:59:51.725520 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:51.725495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 13:59:51.729441 ip-10-0-138-68 kubenswrapper[2579]: I0605 13:59:51.729419 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 14:00:08.352697 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:00:08.352649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:00:08.454524 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:00:08.454488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:00:09.311081 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:00:09.311047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:01:10.095374 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:01:10.095340 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:01:17.091057 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:01:17.091014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:01:42.099951 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:01:42.099916 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:01:51.694574 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:01:51.694541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:00.192580 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:00.192536 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:11.392210 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:11.392111 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:20.598851 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:20.598806 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:29.793553 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:29.793515 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:38.588571 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:38.588536 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:45.857170 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:45.857124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:02:49.482041 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:49.482009 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:02:57.887990 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:02:57.887953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:03:09.287864 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:03:09.287821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:03:17.796992 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:03:17.796949 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:03:54.202182 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:03:54.202106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:04:36.389335 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:04:36.389301 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:04:45.196368 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:04:45.196329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:04:51.750565 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:04:51.750538 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 14:04:51.755844 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:04:51.755823 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 14:04:53.998094 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:04:53.998062 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:05:01.401941 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:05:01.401903 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:05:15.089029 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:05:15.088997 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:05:27.690755 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:05:27.690720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:05:37.097542 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:05:37.097506 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:05:45.188958 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:05:45.188916 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:05:56.288304 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:05:56.288269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:06:02.786689 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:06:02.786647 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:06:13.086392 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:06:13.086353 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:06:24.786633 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:06:24.786586 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:06:42.593693 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:06:42.593608 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:06:51.593817 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:06:51.593784 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:00.492863 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:00.492827 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:06.702828 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:06.702796 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:25.399531 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:25.399496 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:32.085198 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:32.085160 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:43.090564 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:43.090526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:50.001419 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:50.001367 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:07:58.888391 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:07:58.888355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:08:07.088078 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:07.087993 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:08:11.487886 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:11.487844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:08:17.694698 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:17.694665 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:08:30.798700 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:30.798662 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:08:39.589358 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:39.589323 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:08:52.692309 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:52.692274 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:08:56.768595 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:08:56.768561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:09:01.600673 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:01.600635 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:09:12.897602 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:12.897552 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:09:16.011045 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:16.011009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:09:16.112083 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:16.112045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:09:21.300096 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:21.300051 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:09:29.391090 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:29.391011 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:09:30.958433 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:30.958400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:09:47.584335 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:47.584238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:09:51.780470 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:51.780439 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 14:09:51.787058 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:51.787034 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-138-68.ec2.internal_6b68af79435ad678ea4ebc6254094909/kube-rbac-proxy-crio/2.log" Jun 05 14:09:55.997991 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:09:55.997951 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czwmv"] Jun 05 14:10:03.155049 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.155014 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t"] Jun 05 14:10:03.156346 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.156308 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bbd0cf-c0de-4372-86c8-37c72158b091" containerName="authorino" Jun 05 14:10:03.156346 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.156345 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bbd0cf-c0de-4372-86c8-37c72158b091" containerName="authorino" Jun 05 14:10:03.156625 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.156609 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1bbd0cf-c0de-4372-86c8-37c72158b091" containerName="authorino" Jun 05 14:10:03.164970 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.164945 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.167711 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.167683 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a58d8cbe-openshift-default-dockercfg-vp2b4\"" Jun 05 14:10:03.167963 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.167934 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 14:10:03.178898 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.178870 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t"] Jun 05 14:10:03.190378 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.190355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:03.242960 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.242937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301b3bee-6429-4e26-8638-77719f877006-istio-podinfo\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243052 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.242962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-istio-token\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243052 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.242980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-certs\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243052 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.242995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301b3bee-6429-4e26-8638-77719f877006-istiod-ca-cert\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243159 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.243123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-socket\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243200 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.243156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-credential-socket\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243200 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.243176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-data\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243347 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.243262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6j9l\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-kube-api-access-q6j9l\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.243347 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.243303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-envoy\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.245871 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.245855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:03.343661 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-socket\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.343776 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-credential-socket\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.343776 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-data\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.343776 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6j9l\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-kube-api-access-q6j9l\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.343776 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-envoy\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344015 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301b3bee-6429-4e26-8638-77719f877006-istio-podinfo\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344015 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-istio-token\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344015 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.343973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-certs\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344175 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.344079 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-socket\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344175 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.344123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-data\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344175 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.344136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301b3bee-6429-4e26-8638-77719f877006-istiod-ca-cert\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344366 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.344324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-certs\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344366 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.344344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-credential-socket\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.344830 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.344808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301b3bee-6429-4e26-8638-77719f877006-istiod-ca-cert\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.346372 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.346345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-envoy\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.346706 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.346666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301b3bee-6429-4e26-8638-77719f877006-istio-podinfo\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.352627 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.352608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6j9l\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-kube-api-access-q6j9l\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.352709 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.352667 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-istio-token\") pod \"e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.359964 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.359943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:03.459099 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.459077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:03.476024 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.476004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:03.609840 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.609818 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t"] Jun 05 14:10:03.611546 ip-10-0-138-68 kubenswrapper[2579]: W0605 14:10:03.611517 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301b3bee_6429_4e26_8638_77719f877006.slice/crio-1242baefd9eda65572b8f2bf28d37cb5392c1ade8654b641d9e3a523f307b6ca WatchSource:0}: Error finding container 1242baefd9eda65572b8f2bf28d37cb5392c1ade8654b641d9e3a523f307b6ca: Status 404 returned error can't find the container with id 1242baefd9eda65572b8f2bf28d37cb5392c1ade8654b641d9e3a523f307b6ca Jun 05 14:10:03.613700 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:03.613684 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 14:10:04.279374 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:04.279337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" event={"ID":"301b3bee-6429-4e26-8638-77719f877006","Type":"ContainerStarted","Data":"1242baefd9eda65572b8f2bf28d37cb5392c1ade8654b641d9e3a523f307b6ca"} Jun 05 14:10:07.290279 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:07.290243 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:07.896739 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:07.896696 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 14:10:07.896859 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:07.896769 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 14:10:07.896859 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:07.896799 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 14:10:08.302762 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:08.302727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" event={"ID":"301b3bee-6429-4e26-8638-77719f877006","Type":"ContainerStarted","Data":"4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb"} Jun 05 14:10:08.323803 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:08.323754 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" podStartSLOduration=1.041130275 podStartE2EDuration="5.323739157s" totalImagesPullingTime="4.282608882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:10:08.32213713 +0000 UTC m=+2717.137086786" watchObservedRunningTime="2026-06-05 14:10:08.323739157 +0000 UTC m=+2717.138688812" Jun 05 14:10:08.476157 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:08.476130 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:08.477299 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:08.477279 2579 patch_prober.go:28] interesting pod/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 05 14:10:08.477379 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:08.477324 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" podUID="301b3bee-6429-4e26-8638-77719f877006" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 05 14:10:09.480560 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:09.480523 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:09.481137 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:09.481115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:09.649740 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:09.649712 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t"] Jun 05 14:10:09.667421 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:09.667394 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:09.768260 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:09.768183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:10.313138 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:10.313104 2579 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" secret="" err="secret \"e2e-ait-a58d8cbe-openshift-default-dockercfg-vp2b4\" not found" Jun 05 14:10:10.313342 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:10.313109 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:10.314112 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:10.314092 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:11.275426 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:11.275399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:11.318121 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:11.318092 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" podUID="301b3bee-6429-4e26-8638-77719f877006" containerName="istio-proxy" containerID="cri-o://4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb" gracePeriod=30 Jun 05 14:10:15.474987 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:15.474954 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:15.578057 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:15.578029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:15.685943 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:15.685913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:15.751643 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:15.751586 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:15.869187 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:15.869161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:15.967207 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:15.967179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:16.568284 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.568260 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:16.653813 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653762 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-istio-token\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653813 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653789 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-envoy\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653995 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301b3bee-6429-4e26-8638-77719f877006-istiod-ca-cert\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653995 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653843 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-socket\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653995 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653885 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301b3bee-6429-4e26-8638-77719f877006-istio-podinfo\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653995 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653913 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-credential-socket\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653995 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653952 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-certs\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.653995 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.653991 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-data\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.654344 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654025 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6j9l\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-kube-api-access-q6j9l\") pod \"301b3bee-6429-4e26-8638-77719f877006\" (UID: \"301b3bee-6429-4e26-8638-77719f877006\") " Jun 05 14:10:16.654344 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654176 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:10:16.654344 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654266 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/301b3bee-6429-4e26-8638-77719f877006-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:10:16.654344 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654276 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:10:16.654542 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654409 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301b3bee-6429-4e26-8638-77719f877006-istiod-ca-cert\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.654542 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654429 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-socket\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.654542 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654443 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-workload-certs\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.654542 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654470 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:10:16.654542 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.654480 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-data" (OuterVolumeSpecName: "istio-data") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:10:16.656081 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.656057 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:10:16.656182 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.656079 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-istio-token" (OuterVolumeSpecName: "istio-token") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:10:16.656182 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.656155 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/301b3bee-6429-4e26-8638-77719f877006-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 14:10:16.656182 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.656164 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-kube-api-access-q6j9l" (OuterVolumeSpecName: "kube-api-access-q6j9l") pod "301b3bee-6429-4e26-8638-77719f877006" (UID: "301b3bee-6429-4e26-8638-77719f877006"). InnerVolumeSpecName "kube-api-access-q6j9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:10:16.755670 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.755648 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-istio-token\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.755670 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.755668 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-envoy\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.755807 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.755677 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301b3bee-6429-4e26-8638-77719f877006-istio-podinfo\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.755807 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.755686 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-credential-socket\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.755807 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.755694 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301b3bee-6429-4e26-8638-77719f877006-istio-data\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:16.755807 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:16.755702 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6j9l\" (UniqueName: \"kubernetes.io/projected/301b3bee-6429-4e26-8638-77719f877006-kube-api-access-q6j9l\") on node \"ip-10-0-138-68.ec2.internal\" DevicePath \"\"" Jun 05 14:10:17.346298 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.346262 2579 generic.go:356] "Generic (PLEG): container finished" podID="301b3bee-6429-4e26-8638-77719f877006" containerID="4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb" exitCode=0 Jun 05 14:10:17.346493 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.346325 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" Jun 05 14:10:17.346493 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.346350 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" event={"ID":"301b3bee-6429-4e26-8638-77719f877006","Type":"ContainerDied","Data":"4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb"} Jun 05 14:10:17.346493 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.346412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t" event={"ID":"301b3bee-6429-4e26-8638-77719f877006","Type":"ContainerDied","Data":"1242baefd9eda65572b8f2bf28d37cb5392c1ade8654b641d9e3a523f307b6ca"} Jun 05 14:10:17.347254 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.346439 2579 scope.go:117] "RemoveContainer" containerID="4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb" Jun 05 14:10:17.358531 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.358504 2579 scope.go:117] "RemoveContainer" containerID="4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb" Jun 05 14:10:17.358830 ip-10-0-138-68 kubenswrapper[2579]: E0605 14:10:17.358806 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb\": container with ID starting with 4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb not found: ID does not exist" containerID="4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb" Jun 05 14:10:17.358894 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.358842 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb"} err="failed to get container status \"4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb\": rpc error: code = NotFound desc = could not find container \"4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb\": container with ID starting with 4f3b9cd4129129369e6c1c51c78c45fa00a71e4495eb38084f13d53b7718bcfb not found: ID does not exist" Jun 05 14:10:17.369546 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.369523 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t"] Jun 05 14:10:17.374828 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.374804 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a58d8cbe-openshift-default-9989fbdb-7gf6t"] Jun 05 14:10:17.620415 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:17.620360 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="301b3bee-6429-4e26-8638-77719f877006" path="/var/lib/kubelet/pods/301b3bee-6429-4e26-8638-77719f877006/volumes" Jun 05 14:10:19.500389 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:19.500349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:21.978193 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:21.978144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:23.168470 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:23.168430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:23.266292 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:23.266265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:26.833612 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:26.833569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:29.024371 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:29.024317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:29.085175 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:29.085134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:36.482711 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:36.482678 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8c799864b-2kptc_29e2bf6a-f13f-490c-832e-0f6ebd78a7bf/authorino/0.log" Jun 05 14:10:42.056609 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:42.056559 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-rljkj_3194239a-25de-4018-b248-1a627721f2d3/manager/0.log" Jun 05 14:10:42.169121 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:42.169094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl_0a79c73f-5bf3-48c2-830c-17c564695af9/copy-manifests/0.log" Jun 05 14:10:42.175872 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:42.175844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl_0a79c73f-5bf3-48c2-830c-17c564695af9/manager/0.log" Jun 05 14:10:43.790314 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:43.790281 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8c799864b-2kptc_29e2bf6a-f13f-490c-832e-0f6ebd78a7bf/authorino/0.log" Jun 05 14:10:44.141889 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:44.141811 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6rzjq_ce0b3088-54a7-4d69-a70d-1b66f30deeff/kuadrant-console-plugin/0.log" Jun 05 14:10:44.511327 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:44.511298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-czwmv_89fb5917-2eed-4149-abef-35ade16b6134/limitador/0.log" Jun 05 14:10:45.204258 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:45.204234 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d7cf4f6c-j98dj_6130e039-a6c1-4521-a5d1-9fda659a38b4/kube-auth-proxy/0.log" Jun 05 14:10:45.793551 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:45.793526 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffdd48847-ld2hm_958b617c-e62e-4ae8-9789-3eebd8b71fe8/router/0.log" Jun 05 14:10:46.480330 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:46.480305 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9_15b4e8df-af71-4586-8466-d2066e038ea9/storage-initializer/0.log" Jun 05 14:10:46.487699 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:46.487676 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ckfgq9_15b4e8df-af71-4586-8466-d2066e038ea9/main/0.log" Jun 05 14:10:50.440232 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.440176 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2ttzs/must-gather-6nnxx"] Jun 05 14:10:50.440624 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.440552 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301b3bee-6429-4e26-8638-77719f877006" containerName="istio-proxy" Jun 05 14:10:50.440624 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.440565 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="301b3bee-6429-4e26-8638-77719f877006" containerName="istio-proxy" Jun 05 14:10:50.440710 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.440646 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="301b3bee-6429-4e26-8638-77719f877006" containerName="istio-proxy" Jun 05 14:10:50.442814 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.442790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.445705 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.445684 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2ttzs\"/\"kube-root-ca.crt\"" Jun 05 14:10:50.446584 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.446566 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2ttzs\"/\"default-dockercfg-mgz62\"" Jun 05 14:10:50.446808 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.446612 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2ttzs\"/\"openshift-service-ca.crt\"" Jun 05 14:10:50.451733 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.451696 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:50.451966 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.451943 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ttzs/must-gather-6nnxx"] Jun 05 14:10:50.503558 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.503535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71cbbdbc-6e49-4de6-8b81-b490cefeb5a9-must-gather-output\") pod \"must-gather-6nnxx\" (UID: \"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9\") " pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.503659 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.503562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpn2k\" (UniqueName: \"kubernetes.io/projected/71cbbdbc-6e49-4de6-8b81-b490cefeb5a9-kube-api-access-qpn2k\") pod \"must-gather-6nnxx\" (UID: \"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9\") " pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.546685 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.546652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" limit=1024 Jun 05 14:10:50.604093 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.604068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71cbbdbc-6e49-4de6-8b81-b490cefeb5a9-must-gather-output\") pod \"must-gather-6nnxx\" (UID: \"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9\") " pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.604185 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.604098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpn2k\" (UniqueName: \"kubernetes.io/projected/71cbbdbc-6e49-4de6-8b81-b490cefeb5a9-kube-api-access-qpn2k\") pod \"must-gather-6nnxx\" (UID: \"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9\") " pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.604428 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.604410 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71cbbdbc-6e49-4de6-8b81-b490cefeb5a9-must-gather-output\") pod \"must-gather-6nnxx\" (UID: \"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9\") " pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.617369 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.617350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpn2k\" (UniqueName: \"kubernetes.io/projected/71cbbdbc-6e49-4de6-8b81-b490cefeb5a9-kube-api-access-qpn2k\") pod \"must-gather-6nnxx\" (UID: \"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9\") " pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.753407 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.753360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ttzs/must-gather-6nnxx" Jun 05 14:10:50.880785 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:50.880754 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ttzs/must-gather-6nnxx"] Jun 05 14:10:50.883277 ip-10-0-138-68 kubenswrapper[2579]: W0605 14:10:50.883254 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71cbbdbc_6e49_4de6_8b81_b490cefeb5a9.slice/crio-95a05c66783ad0cd527ee089c0c6eb3580f15d5ddff2f0249e5061a0c2d8cbb4 WatchSource:0}: Error finding container 95a05c66783ad0cd527ee089c0c6eb3580f15d5ddff2f0249e5061a0c2d8cbb4: Status 404 returned error can't find the container with id 95a05c66783ad0cd527ee089c0c6eb3580f15d5ddff2f0249e5061a0c2d8cbb4 Jun 05 14:10:51.509629 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:51.509587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/must-gather-6nnxx" event={"ID":"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9","Type":"ContainerStarted","Data":"95a05c66783ad0cd527ee089c0c6eb3580f15d5ddff2f0249e5061a0c2d8cbb4"} Jun 05 14:10:52.518250 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:52.518194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/must-gather-6nnxx" event={"ID":"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9","Type":"ContainerStarted","Data":"1476a3973d6a32e948953ccba898f83b6a42d7ddd1dfd2e2c20863904972f013"} Jun 05 14:10:52.518619 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:52.518259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/must-gather-6nnxx" event={"ID":"71cbbdbc-6e49-4de6-8b81-b490cefeb5a9","Type":"ContainerStarted","Data":"9550c88e7155e092625c259d893e401f9370990971470ca73bcc62f2c0b20b48"} Jun 05 14:10:52.535438 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:52.535390 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2ttzs/must-gather-6nnxx" podStartSLOduration=1.9029917589999998 podStartE2EDuration="2.535376237s" totalImagesPullingTime="632.384478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:10:52.533373211 +0000 UTC m=+2761.348322868" watchObservedRunningTime="2026-06-05 14:10:52.535376237 +0000 UTC m=+2761.350325892" Jun 05 14:10:53.306348 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:53.306307 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-89bh6_c81bb32b-2ad3-4501-ab1f-7cc081c038e5/global-pull-secret-syncer/0.log" Jun 05 14:10:53.394036 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:53.394002 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f8j9h_d3297204-7d3a-41fc-9e8f-e4263bf1745b/konnectivity-agent/0.log" Jun 05 14:10:53.471582 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:53.471555 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-68.ec2.internal_b14f857cc16244b09eb7237ec6ff376b/haproxy/0.log" Jun 05 14:10:58.475126 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:58.475074 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8c799864b-2kptc_29e2bf6a-f13f-490c-832e-0f6ebd78a7bf/authorino/0.log" Jun 05 14:10:58.560668 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:58.560580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6rzjq_ce0b3088-54a7-4d69-a70d-1b66f30deeff/kuadrant-console-plugin/0.log" Jun 05 14:10:58.697500 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:10:58.697470 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-czwmv_89fb5917-2eed-4149-abef-35ade16b6134/limitador/0.log" Jun 05 14:11:00.570870 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:00.570842 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f8cf447dc-vglbz_e1dc3827-1e5c-4261-bd33-a7fa3535fc39/metrics-server/0.log" Jun 05 14:11:00.805184 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:00.805150 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggljg_940947b4-bbf4-49b2-8568-291a79336f6d/node-exporter/0.log" Jun 05 14:11:00.830588 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:00.830485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggljg_940947b4-bbf4-49b2-8568-291a79336f6d/kube-rbac-proxy/0.log" Jun 05 14:11:00.857420 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:00.857274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggljg_940947b4-bbf4-49b2-8568-291a79336f6d/init-textfile/0.log" Jun 05 14:11:01.224401 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:01.224371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-t7tnx_3427df1c-db47-46f3-b623-31d426ec1bb0/prometheus-operator-admission-webhook/0.log" Jun 05 14:11:03.039856 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:03.039754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-6mrtd_95d67839-6a9b-4de4-82e3-4ed07fa42ff2/networking-console-plugin/0.log" Jun 05 14:11:04.267422 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:04.267380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54568b78b-jxfxt_b8474f93-213a-43cd-becc-f3dad7339776/console/0.log" Jun 05 14:11:04.301243 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:04.301197 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-8pnvg_0f34352f-a9f4-4af7-9fad-f6c4677d7581/download-server/0.log" Jun 05 14:11:05.025707 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:05.025671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-fb2vr_be91f03a-98b2-41a2-af18-3f09d17c8250/volume-data-source-validator/0.log" Jun 05 14:11:06.311615 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.311567 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm"] Jun 05 14:11:06.316466 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.316439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.322651 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.322626 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kplxt_885c3cde-1614-4114-a516-cdff6c5b5966/dns/0.log" Jun 05 14:11:06.324204 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.324174 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm"] Jun 05 14:11:06.351061 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.351037 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kplxt_885c3cde-1614-4114-a516-cdff6c5b5966/kube-rbac-proxy/0.log" Jun 05 14:11:06.374229 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.374168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwzbn\" (UniqueName: \"kubernetes.io/projected/0d3c011f-722c-46b8-86c3-c427e8ab9241-kube-api-access-bwzbn\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.374436 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.374335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-sys\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.374436 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.374374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-podres\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.374548 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.374447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-lib-modules\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.374548 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.374505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-proc\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.475815 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.475751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-sys\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476029 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.475829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-podres\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476029 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.475872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-lib-modules\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476029 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.475907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-proc\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476029 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.475991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwzbn\" (UniqueName: \"kubernetes.io/projected/0d3c011f-722c-46b8-86c3-c427e8ab9241-kube-api-access-bwzbn\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476486 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.476456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-sys\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476633 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.476612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-podres\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476743 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.476724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-lib-modules\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.476796 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.476784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d3c011f-722c-46b8-86c3-c427e8ab9241-proc\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.484528 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.484498 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwzbn\" (UniqueName: \"kubernetes.io/projected/0d3c011f-722c-46b8-86c3-c427e8ab9241-kube-api-access-bwzbn\") pod \"perf-node-gather-daemonset-zbxnm\" (UID: \"0d3c011f-722c-46b8-86c3-c427e8ab9241\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.517281 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.517248 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4f4r_a04c5bdb-957a-4fd2-b97a-d462c80c807f/dns-node-resolver/0.log" Jun 05 14:11:06.631972 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.631877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:06.821205 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:06.821166 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm"] Jun 05 14:11:06.823098 ip-10-0-138-68 kubenswrapper[2579]: W0605 14:11:06.823033 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d3c011f_722c_46b8_86c3_c427e8ab9241.slice/crio-2418f1d791670f8d6a67eeba7416703cc7174f1adcd113968819a27e83eb8e21 WatchSource:0}: Error finding container 2418f1d791670f8d6a67eeba7416703cc7174f1adcd113968819a27e83eb8e21: Status 404 returned error can't find the container with id 2418f1d791670f8d6a67eeba7416703cc7174f1adcd113968819a27e83eb8e21 Jun 05 14:11:07.119683 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:07.119647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bd95566f8-vlczq_1d302655-f35b-44b9-a0ba-64c1590b5040/registry/0.log" Jun 05 14:11:07.140852 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:07.140820 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxpq6_6748f1dc-bb7c-4921-9543-fbc7b0c0f508/node-ca/0.log" Jun 05 14:11:07.632274 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:07.632203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" event={"ID":"0d3c011f-722c-46b8-86c3-c427e8ab9241","Type":"ContainerStarted","Data":"6b29b45bfcfc92e2a8e00a1f37ce0b1c7e3e714c902ca00fad4cd30af04cddf4"} Jun 05 14:11:07.632797 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:07.632307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" event={"ID":"0d3c011f-722c-46b8-86c3-c427e8ab9241","Type":"ContainerStarted","Data":"2418f1d791670f8d6a67eeba7416703cc7174f1adcd113968819a27e83eb8e21"} Jun 05 14:11:07.633245 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:07.633201 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:07.650930 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:07.650851 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" podStartSLOduration=1.650825896 podStartE2EDuration="1.650825896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:07.648071414 +0000 UTC m=+2776.463021069" watchObservedRunningTime="2026-06-05 14:11:07.650825896 +0000 UTC m=+2776.465775553" Jun 05 14:11:08.302277 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:08.302138 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d7cf4f6c-j98dj_6130e039-a6c1-4521-a5d1-9fda659a38b4/kube-auth-proxy/0.log" Jun 05 14:11:08.567697 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:08.567600 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffdd48847-ld2hm_958b617c-e62e-4ae8-9789-3eebd8b71fe8/router/0.log" Jun 05 14:11:09.256738 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:09.256707 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nf82x_cd513d02-8a9b-45fb-8291-a243be7fab29/serve-healthcheck-canary/0.log" Jun 05 14:11:09.948860 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:09.948822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmm9v_413b40e8-afad-4160-ac59-264f100113cb/kube-rbac-proxy/0.log" Jun 05 14:11:09.978629 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:09.978590 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmm9v_413b40e8-afad-4160-ac59-264f100113cb/exporter/0.log" Jun 05 14:11:10.004124 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:10.004098 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmm9v_413b40e8-afad-4160-ac59-264f100113cb/extractor/0.log" Jun 05 14:11:12.664529 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:12.664487 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-rljkj_3194239a-25de-4018-b248-1a627721f2d3/manager/0.log" Jun 05 14:11:12.688183 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:12.688145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl_0a79c73f-5bf3-48c2-830c-17c564695af9/manager/0.log" Jun 05 14:11:12.707642 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:12.707609 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-dckbl_0a79c73f-5bf3-48c2-830c-17c564695af9/copy-manifests/0.log" Jun 05 14:11:14.439487 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:14.439449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-686f455b98-tnkjz_58d29719-53f3-440d-ab38-daaa155ed393/manager/0.log" Jun 05 14:11:14.655769 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:14.655732 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-zbxnm" Jun 05 14:11:19.944679 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:19.944618 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-fpd86_d3221085-165c-46ee-9fc3-81680a2ea6d1/migrator/0.log" Jun 05 14:11:19.969596 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:19.969565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-fpd86_d3221085-165c-46ee-9fc3-81680a2ea6d1/graceful-termination/0.log" Jun 05 14:11:20.057413 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:20.057385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d7cf4f6c-j98dj_6130e039-a6c1-4521-a5d1-9fda659a38b4/kube-auth-proxy/0.log" Jun 05 14:11:20.234413 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:20.234380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffdd48847-ld2hm_958b617c-e62e-4ae8-9789-3eebd8b71fe8/router/0.log" Jun 05 14:11:20.418145 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:20.418113 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fsn99_6cec6ea4-724b-4e32-929c-d6cc0e169cf9/kube-storage-version-migrator-operator/1.log" Jun 05 14:11:20.419117 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:20.419091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fsn99_6cec6ea4-724b-4e32-929c-d6cc0e169cf9/kube-storage-version-migrator-operator/0.log" Jun 05 14:11:21.585982 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:21.585952 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d7cf4f6c-j98dj_6130e039-a6c1-4521-a5d1-9fda659a38b4/kube-auth-proxy/0.log" Jun 05 14:11:21.686911 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:21.686875 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2tqdq_c55c0aea-bc6e-47b7-8d1d-40ef51e108af/kube-multus/0.log" Jun 05 14:11:21.760379 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:21.760331 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffdd48847-ld2hm_958b617c-e62e-4ae8-9789-3eebd8b71fe8/router/0.log" Jun 05 14:11:22.017831 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.017787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/kube-multus-additional-cni-plugins/0.log" Jun 05 14:11:22.039804 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.039716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/egress-router-binary-copy/0.log" Jun 05 14:11:22.059636 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.059601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/cni-plugins/0.log" Jun 05 14:11:22.079950 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.079918 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/bond-cni-plugin/0.log" Jun 05 14:11:22.100457 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.100423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/routeoverride-cni/0.log" Jun 05 14:11:22.119857 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.119824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/whereabouts-cni-bincopy/0.log" Jun 05 14:11:22.140510 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.140480 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9qn9_0eb1884f-3556-45a1-9454-c03c4c5cc683/whereabouts-cni/0.log" Jun 05 14:11:22.196578 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.196550 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pkp4h_49a453a5-c753-4d32-95bb-2d5bd4e44e13/network-metrics-daemon/0.log" Jun 05 14:11:22.214849 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:22.214811 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pkp4h_49a453a5-c753-4d32-95bb-2d5bd4e44e13/kube-rbac-proxy/0.log" Jun 05 14:11:23.255519 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.255485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/ovn-controller/0.log" Jun 05 14:11:23.274838 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.274810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/ovn-acl-logging/0.log" Jun 05 14:11:23.300387 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.300355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/kube-rbac-proxy-node/0.log" Jun 05 14:11:23.325181 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.325134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 14:11:23.342022 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.341994 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/northd/0.log" Jun 05 14:11:23.361595 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.361565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/nbdb/0.log" Jun 05 14:11:23.382172 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.382130 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/sbdb/0.log" Jun 05 14:11:23.435898 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.435866 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7drzg_f1bd777f-221f-4780-ab4b-313e42b82381/ovnkube-controller/0.log" Jun 05 14:11:23.543406 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.543303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d7cf4f6c-j98dj_6130e039-a6c1-4521-a5d1-9fda659a38b4/kube-auth-proxy/0.log" Jun 05 14:11:23.715896 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:23.715862 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffdd48847-ld2hm_958b617c-e62e-4ae8-9789-3eebd8b71fe8/router/0.log" Jun 05 14:11:25.169703 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:25.169669 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-hr5dx_2b6992f4-2ca7-4125-a97f-d66c85b2b933/check-endpoints/0.log" Jun 05 14:11:25.234715 ip-10-0-138-68 kubenswrapper[2579]: I0605 14:11:25.234688 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-r2c6m_75f1bd40-9d60-4e2d-99d0-0818b5856efb/network-check-target-container/0.log"