Jun 07 16:24:36.884780 ip-10-0-129-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 07 16:24:36.884796 ip-10-0-129-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 07 16:24:36.884807 ip-10-0-129-26 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 07 16:24:36.885036 ip-10-0-129-26 systemd[1]: Failed to start Kubernetes Kubelet. Jun 07 16:24:47.046427 ip-10-0-129-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 07 16:24:47.046445 ip-10-0-129-26 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3566a2de541442b98de6cd40eb7f7793 -- Jun 07 16:27:10.494914 ip-10-0-129-26 systemd[1]: Starting Kubernetes Kubelet... Jun 07 16:27:10.830627 ip-10-0-129-26 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:10.830627 ip-10-0-129-26 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 16:27:10.830627 ip-10-0-129-26 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:10.830627 ip-10-0-129-26 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 16:27:10.830627 ip-10-0-129-26 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:10.832493 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.832417 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 16:27:10.839067 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839053 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:10.839067 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839066 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839070 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839073 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839076 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839079 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839082 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839084 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839087 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839091 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839095 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839099 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839102 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839105 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839107 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839110 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839112 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839115 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839118 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839120 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839122 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:10.839138 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839125 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839128 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839130 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839133 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839135 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839138 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839140 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839143 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839146 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839148 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839151 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839153 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839156 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839158 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839161 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839163 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839168 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839170 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839173 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:10.839587 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839175 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839177 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839180 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839182 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839184 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839186 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839189 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839191 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839193 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839196 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839198 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839200 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839203 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839205 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839209 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839211 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839213 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839216 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839218 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839220 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:10.840103 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839223 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839226 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839229 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839231 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839233 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839236 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839238 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839241 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839243 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839246 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839250 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839253 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839256 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839259 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839261 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839264 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839267 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839269 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839272 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:10.840563 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839274 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839276 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839279 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839283 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839285 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839288 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839291 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839293 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839296 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839298 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839301 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839303 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839306 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839308 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839311 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839313 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839315 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839318 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839321 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:10.841011 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839990 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.839997 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840000 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840002 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840005 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840008 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840011 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840014 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840016 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840018 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840021 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840023 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840026 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840028 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840031 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840033 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840036 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840038 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840042 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840045 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:10.841454 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840047 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840049 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840052 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840054 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840057 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840059 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840061 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840063 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840066 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840068 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840070 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840073 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840075 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840077 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840080 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840082 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840084 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840086 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840090 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840092 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:10.841949 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840094 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840098 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840101 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840104 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840107 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840109 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840112 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840114 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840117 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840119 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840122 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840125 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840128 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840130 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840132 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840135 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840137 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840139 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840142 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840144 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:10.842448 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840146 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840149 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840151 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840153 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840156 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840158 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840161 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840163 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840165 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840167 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840171 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840175 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840178 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840181 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840184 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840187 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840190 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840192 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840195 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:10.842951 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840197 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840200 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840204 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840207 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840210 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840213 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840216 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840218 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840221 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840224 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840226 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840228 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840232 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840234 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840236 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840239 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840241 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840244 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840246 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:10.843387 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840249 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840756 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840763 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840766 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840768 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840771 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840774 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840776 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840779 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840781 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840784 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840786 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840789 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840792 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840796 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840799 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840803 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840806 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840809 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:10.843856 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840811 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840814 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840816 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840819 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840822 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840825 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840827 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840829 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840832 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840834 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840836 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840839 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840841 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840843 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840846 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840848 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840851 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840853 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840856 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840859 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:10.844303 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840861 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840864 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840867 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840870 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840872 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840875 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840877 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840879 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840882 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840884 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840886 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840889 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840891 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840893 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840896 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840898 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840900 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840902 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840906 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:10.844784 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840909 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840912 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840915 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840918 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840920 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840922 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840925 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840927 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840930 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840933 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840935 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840938 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840940 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840943 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840945 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840948 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840950 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840953 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840955 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840958 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:10.845220 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840960 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840963 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840965 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840967 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840970 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840972 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840974 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840977 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840979 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840981 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840984 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840986 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840989 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840991 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840996 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.840998 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841001 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841003 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841005 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:10.845730 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841008 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841011 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841083 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841090 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841095 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841099 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841103 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841106 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841110 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841114 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841117 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841120 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841123 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841125 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841128 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841131 2561 flags.go:64] FLAG: --cgroup-root="" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841134 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841137 2561 flags.go:64] FLAG: --client-ca-file="" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841140 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841142 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841146 2561 flags.go:64] FLAG: --cluster-domain="" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841149 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841152 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 16:27:10.846190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841155 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841159 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841162 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841165 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841168 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841170 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841173 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841176 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841178 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841181 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841184 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841188 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841190 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841193 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841195 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841198 2561 flags.go:64] FLAG: --enable-server="true" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841201 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841205 2561 flags.go:64] FLAG: --event-burst="100" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841208 2561 flags.go:64] FLAG: --event-qps="50" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841210 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841213 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841216 2561 flags.go:64] FLAG: --eviction-hard="" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841219 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841221 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841224 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 16:27:10.846763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841227 2561 flags.go:64] FLAG: --eviction-soft="" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841230 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841232 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841235 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841238 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841240 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841243 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841246 2561 flags.go:64] FLAG: --feature-gates="" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841249 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841252 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841254 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841257 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841260 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841262 2561 flags.go:64] FLAG: --help="false" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841265 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-26.ec2.internal" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841268 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841270 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841273 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841276 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841279 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841282 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841285 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841287 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 16:27:10.847335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841290 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841293 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841296 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841299 2561 flags.go:64] FLAG: --kube-reserved="" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841301 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841304 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841307 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841309 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841314 2561 flags.go:64] FLAG: --lock-file="" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841316 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841319 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841322 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841327 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841329 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841332 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841335 2561 flags.go:64] FLAG: --logging-format="text" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841337 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841341 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841343 2561 flags.go:64] FLAG: --manifest-url="" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841346 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841349 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841352 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841356 2561 flags.go:64] FLAG: --max-pods="110" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841359 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841361 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 16:27:10.847949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841364 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841367 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841369 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841372 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841376 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841382 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841385 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841388 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841391 2561 flags.go:64] FLAG: --pod-cidr="" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841394 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841399 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841402 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841404 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841407 2561 flags.go:64] FLAG: --port="10250" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841410 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841414 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002d9c418ed4dc07f" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841417 2561 flags.go:64] FLAG: --qos-reserved="" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841419 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841422 2561 flags.go:64] FLAG: --register-node="true" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841424 2561 flags.go:64] FLAG: --register-with-taints="" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841428 2561 flags.go:64] FLAG: --registry-burst="10" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841430 2561 flags.go:64] FLAG: --registry-qps="5" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841433 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841435 2561 flags.go:64] FLAG: --reserved-memory="" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841439 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 16:27:10.848534 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841441 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841444 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841447 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841449 2561 flags.go:64] FLAG: --runonce="false" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841452 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841455 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841458 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841460 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841463 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841466 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841469 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841472 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841475 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841478 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841481 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841483 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841486 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841489 2561 flags.go:64] FLAG: --system-cgroups="" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841492 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841497 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841500 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841502 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841507 2561 flags.go:64] FLAG: --tls-min-version="" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841510 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841513 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 16:27:10.849177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841515 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841518 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841520 2561 flags.go:64] FLAG: --v="2" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841524 2561 flags.go:64] FLAG: --version="false" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841527 2561 flags.go:64] FLAG: --vmodule="" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841531 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.841534 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841657 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841662 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841665 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841667 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841670 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841672 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841674 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841677 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841679 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841682 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841684 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841687 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841690 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841693 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:10.849872 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841695 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841698 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841701 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841705 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841709 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841712 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841714 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841717 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841721 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841724 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841727 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841729 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841733 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841736 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841739 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841742 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841744 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841747 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841749 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:10.850443 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841752 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841754 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841757 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841759 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841762 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841764 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841767 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841769 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841771 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841774 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841776 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841780 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841782 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841785 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841787 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841789 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841792 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841794 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841797 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:10.850925 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841799 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841802 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841805 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841808 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841810 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841813 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841815 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841817 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841820 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841822 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841824 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841827 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841829 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841832 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841834 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841836 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841840 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841844 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841847 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841849 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:10.851374 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841851 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841854 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841856 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841858 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841862 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841865 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841867 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841869 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841872 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841874 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841876 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841879 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841882 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841884 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841888 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841890 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841893 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841895 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841898 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841900 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:10.851871 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841903 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841905 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841907 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841909 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841912 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841914 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.841916 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.842520 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.848732 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.848745 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.849562 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.849573 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849625 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849646 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849651 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:10.852369 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849655 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849658 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849661 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849664 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849667 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849669 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849672 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849674 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849677 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849680 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849682 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849685 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849687 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849689 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849692 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849694 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849697 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849699 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849701 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849704 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:10.852778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849706 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849708 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849711 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849713 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849715 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849718 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849723 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849725 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849728 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849730 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849733 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849735 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849738 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849740 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849742 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849745 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849747 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849750 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849752 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849754 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:10.853252 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849756 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849759 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849761 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849763 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849765 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849768 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849770 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849772 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849775 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849777 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849779 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849782 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849784 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849786 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849789 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849791 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849794 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849796 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849799 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:10.853850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849802 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849805 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849807 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849810 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849812 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849815 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849817 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849819 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849822 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849824 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849826 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849829 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849831 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849833 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849836 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849838 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849840 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849844 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:10.854296 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849848 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849851 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849855 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849858 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849861 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849864 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849866 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849869 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849871 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849874 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849877 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849879 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849882 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849885 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849888 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849891 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849893 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849896 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:10.854850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.849898 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.849903 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850032 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850036 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850040 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850042 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850045 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850048 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850050 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850052 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850055 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850057 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850060 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850062 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850064 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:10.855301 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850067 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850069 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850071 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850074 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850076 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850079 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850081 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850083 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850086 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850088 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850090 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850093 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850095 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850098 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850101 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850104 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850106 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850109 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850111 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850113 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:10.855685 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850116 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850118 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850120 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850122 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850125 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850127 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850129 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850131 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850134 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850136 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850138 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850140 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850143 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850145 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850148 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850150 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850152 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850155 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850157 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850160 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:10.856322 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850162 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850164 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850167 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850169 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850172 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850174 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850176 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850179 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850183 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850186 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850189 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850192 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850195 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850198 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850200 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850203 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850205 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850208 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850210 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:10.857065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850213 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850215 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850217 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850219 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850222 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850224 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850226 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850229 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850231 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850233 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850236 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850239 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850242 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850245 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850248 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850250 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850252 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850256 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850259 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:10.857508 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850262 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850265 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850267 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850270 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850273 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850275 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850278 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:10.850280 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.850285 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.850389 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.852229 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.853442 2561 server.go:1019] "Starting client certificate rotation" Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.853566 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:27:10.858122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.853618 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:27:10.858463 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.856002 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:27:10.861378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.861356 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:27:10.875161 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.875050 2561 log.go:25] "Validated CRI v1 runtime API" Jun 07 16:27:10.877709 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.877693 2561 log.go:25] "Validated CRI v1 image API" Jun 07 16:27:10.880214 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.880198 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 16:27:10.882361 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.882344 2561 fs.go:135] Filesystem UUIDs: map[09a23848-b38e-4763-a5c3-40e5478a2930:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7f3e9c91-71d6-4941-9618-f73f6f7339cf:/dev/nvme0n1p3] Jun 07 16:27:10.882417 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.882364 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 16:27:10.886724 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.886706 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:27:10.886909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.886796 2561 manager.go:216] Machine: {Timestamp:2026-06-07 16:27:10.886289514 +0000 UTC m=+0.289638177 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3286265 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b40c0f67efa314dd66c678943a1ce SystemUUID:ec2b40c0-f67e-fa31-4dd6-6c678943a1ce BootID:3566a2de-5414-42b9-8de6-cd40eb7f7793 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:fb:c3:e8:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:fb:c3:e8:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:5d:a7:da:90:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 16:27:10.886909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.886910 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 16:27:10.886997 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.886978 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 16:27:10.889286 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.889266 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 16:27:10.889429 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.889289 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 16:27:10.889983 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.889974 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 16:27:10.890014 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.889986 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 16:27:10.890014 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.889993 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:27:10.890762 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.890743 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:27:10.891492 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.891483 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 16:27:10.894199 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894188 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:27:10.894316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894307 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 16:27:10.894350 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894342 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 07 16:27:10.894377 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894356 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 16:27:10.894377 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894371 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 16:27:10.894433 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894383 2561 kubelet.go:398] "Adding apiserver pod source" Jun 07 16:27:10.894433 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894394 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 16:27:10.894917 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894895 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:27:10.894978 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.894924 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:27:10.897124 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.897108 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 16:27:10.898578 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.898561 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 16:27:10.898658 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.898593 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 16:27:10.899981 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.899968 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 16:27:10.900025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.899991 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 16:27:10.900025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900002 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 16:27:10.900025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900010 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 16:27:10.900025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900023 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900032 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900044 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900051 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900060 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900067 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900078 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 16:27:10.900122 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.900098 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 16:27:10.901681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.901669 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 16:27:10.901719 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.901682 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 16:27:10.904720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.904707 2561 server.go:1268] "Started kubelet" Jun 07 16:27:10.905049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.904855 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 16:27:10.905228 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.905204 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 16:27:10.905294 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.905158 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 16:27:10.905535 ip-10-0-129-26 systemd[1]: Started Kubernetes Kubelet. Jun 07 16:27:10.908512 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.908493 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 16:27:10.908924 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.908905 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 16:27:10.909276 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.908905 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ph4pv" Jun 07 16:27:10.909276 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.908940 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 16:27:10.909766 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.909739 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 16:27:10.910893 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.910455 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 07 16:27:10.913012 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.912991 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ph4pv" Jun 07 16:27:10.914011 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.913993 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 16:27:10.915845 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.914961 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-26.ec2.internal.18b6d94dd0758202 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-26.ec2.internal,UID:ip-10-0-129-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-26.ec2.internal,},FirstTimestamp:2026-06-07 16:27:10.904680962 +0000 UTC m=+0.308029623,LastTimestamp:2026-06-07 16:27:10.904680962 +0000 UTC m=+0.308029623,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-26.ec2.internal,}" Jun 07 16:27:10.917785 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.917769 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 16:27:10.917851 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.917787 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 16:27:10.917952 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.917923 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:10.918419 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918405 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 16:27:10.918506 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918405 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 16:27:10.918506 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918449 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 16:27:10.918604 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918505 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 07 16:27:10.918604 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918522 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 07 16:27:10.918826 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918809 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 16:27:10.918909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918827 2561 factory.go:55] Registering systemd factory Jun 07 16:27:10.918909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.918837 2561 factory.go:223] Registration of the systemd container factory successfully Jun 07 16:27:10.919409 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.919396 2561 factory.go:153] Registering CRI-O factory Jun 07 16:27:10.919471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.919413 2561 factory.go:223] Registration of the crio container factory successfully Jun 07 16:27:10.919471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.919435 2561 factory.go:103] Registering Raw factory Jun 07 16:27:10.919471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.919448 2561 manager.go:1196] Started watching for new ooms in manager Jun 07 16:27:10.919893 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.919880 2561 manager.go:349] Starting recovery of all containers Jun 07 16:27:10.921845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.921825 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:10.926236 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.926210 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-26.ec2.internal\" not found" node="ip-10-0-129-26.ec2.internal" Jun 07 16:27:10.931185 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.931169 2561 manager.go:354] Recovery completed Jun 07 16:27:10.935142 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.935130 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:10.936979 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.936966 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:10.937030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.936991 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:10.937030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.936999 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:10.937505 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.937488 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 16:27:10.937505 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.937502 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:10.937681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.937502 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 16:27:10.937681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.937578 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:27:10.938181 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.938155 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:10.938260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.938196 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:10.938260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.938211 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:10.939707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.939692 2561 policy_none.go:49] "None policy: Start" Jun 07 16:27:10.939746 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.939713 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 16:27:10.939746 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.939726 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 16:27:10.941236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.941225 2561 policy_none.go:47] "Start" Jun 07 16:27:10.979207 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979190 2561 manager.go:337] "Starting Device Plugin manager" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.979223 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979233 2561 server.go:87] "Starting device plugin registration server" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979418 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979427 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979558 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979680 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.979690 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.980069 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.980104 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.986908 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.988113 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.988143 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.988159 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:10.988209 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 16:27:10.999335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:10.990297 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:11.079519 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.079483 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:11.080426 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.080409 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:11.080490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.080441 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:11.080490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.080452 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:11.080490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.080474 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.088399 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.088360 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.088399 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.088379 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-26.ec2.internal\": node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.088488 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.088440 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal"] Jun 07 16:27:11.088488 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.088488 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:11.089178 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.089157 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:11.089178 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.089179 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:11.089309 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.089190 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:11.090929 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.090910 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:11.091036 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.091021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.091101 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.091052 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:11.092907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.092888 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:11.092992 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.092913 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:11.092992 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.092923 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:11.092992 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.092930 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:11.092992 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.092951 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:11.092992 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.092963 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:11.094519 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.094504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.094558 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.094537 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:11.095175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.095160 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:11.095266 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.095188 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:11.095266 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.095202 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:11.103251 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.103236 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.119574 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.119557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0b78fd36e18c240d772fa14def0768e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-26.ec2.internal\" (UID: \"a0b78fd36e18c240d772fa14def0768e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.119622 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.119579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/668b873de835fc263231a6f5c348c49b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal\" (UID: \"668b873de835fc263231a6f5c348c49b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.119622 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.119596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/668b873de835fc263231a6f5c348c49b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal\" (UID: \"668b873de835fc263231a6f5c348c49b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.121156 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.121143 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-26.ec2.internal\" not found" node="ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.125523 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.125508 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-26.ec2.internal\" not found" node="ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.203890 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.203870 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.220149 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.220129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/668b873de835fc263231a6f5c348c49b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal\" (UID: \"668b873de835fc263231a6f5c348c49b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.220220 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.220158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/668b873de835fc263231a6f5c348c49b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal\" (UID: \"668b873de835fc263231a6f5c348c49b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.220220 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.220176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0b78fd36e18c240d772fa14def0768e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-26.ec2.internal\" (UID: \"a0b78fd36e18c240d772fa14def0768e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.220316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.220233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0b78fd36e18c240d772fa14def0768e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-26.ec2.internal\" (UID: \"a0b78fd36e18c240d772fa14def0768e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.220316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.220247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/668b873de835fc263231a6f5c348c49b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal\" (UID: \"668b873de835fc263231a6f5c348c49b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.220316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.220287 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/668b873de835fc263231a6f5c348c49b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal\" (UID: \"668b873de835fc263231a6f5c348c49b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.304617 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.304597 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.405296 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.405242 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.425767 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.425750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.431297 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.431283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:11.506323 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.506289 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.606749 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.606731 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.707219 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.707166 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.807693 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.807670 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.853113 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.853087 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 16:27:11.853741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.853232 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:11.853741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.853276 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:11.908731 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:11.908529 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:11.918253 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.918217 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 16:22:10 +0000 UTC" deadline="2027-12-06 08:58:22.370413824 +0000 UTC" Jun 07 16:27:11.918253 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.918253 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13120h31m10.452166606s" Jun 07 16:27:11.949850 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:11.949816 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b78fd36e18c240d772fa14def0768e.slice/crio-c7f56ec0f39b1951053d9df8bef69e84c313f93518e4de7dc265edd8350e696b WatchSource:0}: Error finding container c7f56ec0f39b1951053d9df8bef69e84c313f93518e4de7dc265edd8350e696b: Status 404 returned error can't find the container with id c7f56ec0f39b1951053d9df8bef69e84c313f93518e4de7dc265edd8350e696b Jun 07 16:27:11.951687 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:11.951661 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668b873de835fc263231a6f5c348c49b.slice/crio-cceb36adba2aaea43f7a6c8dfd5e93245f4fb846ea84fa547e6dcbda2a8370a1 WatchSource:0}: Error finding container cceb36adba2aaea43f7a6c8dfd5e93245f4fb846ea84fa547e6dcbda2a8370a1: Status 404 returned error can't find the container with id cceb36adba2aaea43f7a6c8dfd5e93245f4fb846ea84fa547e6dcbda2a8370a1 Jun 07 16:27:11.954507 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.954493 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:27:11.991325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.991278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" event={"ID":"668b873de835fc263231a6f5c348c49b","Type":"ContainerStarted","Data":"cceb36adba2aaea43f7a6c8dfd5e93245f4fb846ea84fa547e6dcbda2a8370a1"} Jun 07 16:27:11.992208 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:11.992183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" event={"ID":"a0b78fd36e18c240d772fa14def0768e","Type":"ContainerStarted","Data":"c7f56ec0f39b1951053d9df8bef69e84c313f93518e4de7dc265edd8350e696b"} Jun 07 16:27:12.009327 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:12.009306 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:12.109774 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:12.109753 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-26.ec2.internal\" not found" Jun 07 16:27:12.123392 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.123372 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:12.124526 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.124511 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:12.219140 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.219120 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" Jun 07 16:27:12.228781 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.228761 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:27:12.229938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.229926 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" Jun 07 16:27:12.238361 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.238347 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:27:12.896134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.896105 2561 apiserver.go:52] "Watching apiserver" Jun 07 16:27:12.903300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.903279 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 16:27:12.905683 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.905652 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal","openshift-multus/multus-lftfj","openshift-network-operator/iptables-alerter-h59cl","kube-system/konnectivity-agent-4j6r9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv","openshift-cluster-node-tuning-operator/tuned-fqnj6","openshift-dns/node-resolver-fjhsn","openshift-multus/multus-additional-cni-plugins-2wqk7","openshift-multus/network-metrics-daemon-hs6wc","openshift-network-diagnostics/network-check-target-49x6l","openshift-ovn-kubernetes/ovnkube-node-s8xwv","kube-system/global-pull-secret-syncer-t4z6n","kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal","openshift-image-registry/node-ca-zf7mk"] Jun 07 16:27:12.908395 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.908374 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:12.911364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.910525 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9v698\"" Jun 07 16:27:12.911364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.910554 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.911364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.910672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.911364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.910788 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.912684 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.912665 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 16:27:12.913316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.913298 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:12.913613 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.913595 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.913764 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.913650 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 16:27:12.913889 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.913871 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.914080 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.914066 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 16:27:12.914151 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.914086 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fknfb\"" Jun 07 16:27:12.914217 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.914203 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 16:27:12.914960 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.914941 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:12.915762 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.915727 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84w2s\"" Jun 07 16:27:12.915762 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.915727 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.916013 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.915983 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 16:27:12.916299 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.916284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.916937 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.916922 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 16:27:12.917107 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.917091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2wcf\"" Jun 07 16:27:12.917198 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.917183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.917258 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.917232 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 16:27:12.918569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.918553 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 16:27:12.918963 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.918945 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 16:27:12.919326 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.919304 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.919410 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.919345 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.919460 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.919406 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hbmgx\"" Jun 07 16:27:12.919717 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.919699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.921666 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.921621 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.921755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.921673 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-626gd\"" Jun 07 16:27:12.921839 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.921818 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.922042 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.922025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:12.922117 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:12.922093 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:12.924228 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.924211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:12.926428 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.926320 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.926428 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.926352 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 16:27:12.926566 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.926485 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lftfj" Jun 07 16:27:12.926621 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.926595 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l687z\"" Jun 07 16:27:12.926893 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.926874 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.928673 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.928655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 16:27:12.929614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929427 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:12.929614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929458 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 16:27:12.929614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929478 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 16:27:12.929614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929482 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-994m5\"" Jun 07 16:27:12.929614 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:12.929488 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:12.929614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929461 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e75d46f-5528-40c8-8331-1d417012fcde-konnectivity-ca\") pod \"konnectivity-agent-4j6r9\" (UID: \"4e75d46f-5528-40c8-8331-1d417012fcde\") " pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-systemd\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-tuned\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-run-netns\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-var-lib-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysctl-d\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdhlt\" (UniqueName: \"kubernetes.io/projected/cb97ce61-1167-4141-944b-bd2b1d5755ec-kube-api-access-hdhlt\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-sys\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.929938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljjdl\" (UniqueName: \"kubernetes.io/projected/d77b11a4-7705-45bd-8949-a8ad593cc39f-kube-api-access-ljjdl\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.929973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-log-socket\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-run\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-lib-modules\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-host\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-etc-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930120 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-node-log\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-cni-bin\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovn-node-metrics-cert\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b571422-0e25-476f-b64d-4d20b0753e61-host-slash\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysctl-conf\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-var-lib-kubelet\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77b11a4-7705-45bd-8949-a8ad593cc39f-tmp\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6l8n\" (UniqueName: \"kubernetes.io/projected/42d5ecfd-006a-4b61-accc-df6012082fe4-kube-api-access-n6l8n\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ks58\" (UniqueName: \"kubernetes.io/projected/0b571422-0e25-476f-b64d-4d20b0753e61-kube-api-access-7ks58\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-registration-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.930430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-sys-fs\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42d5ecfd-006a-4b61-accc-df6012082fe4-hosts-file\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d5ecfd-006a-4b61-accc-df6012082fe4-tmp-dir\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-systemd\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-kubelet\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-kubernetes\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-cni-netd\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovnkube-config\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovnkube-script-lib\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-systemd-units\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-ovn\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-env-overrides\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pjpv\" (UniqueName: \"kubernetes.io/projected/f19729ea-10f4-45f7-b59c-a13d03459cc6-kube-api-access-7pjpv\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.931602 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b571422-0e25-476f-b64d-4d20b0753e61-iptables-alerter-script\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:12.931602 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e75d46f-5528-40c8-8331-1d417012fcde-agent-certs\") pod \"konnectivity-agent-4j6r9\" (UID: \"4e75d46f-5528-40c8-8331-1d417012fcde\") " pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:12.931602 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.930856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-socket-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.932497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.931955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-device-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:12.932497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.931998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-modprobe-d\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.932497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.932029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysconfig\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:12.932497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.932056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-slash\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:12.932497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.932324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:12.934816 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.934791 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtwzz\"" Jun 07 16:27:12.934816 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.934805 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 16:27:12.935020 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.934999 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 16:27:12.935418 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.935387 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:12.935486 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:12.935443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:12.950903 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.950887 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s4ppm" Jun 07 16:27:12.957751 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:12.957732 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s4ppm" Jun 07 16:27:13.020490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.020466 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 16:27:13.032971 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.032940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b571422-0e25-476f-b64d-4d20b0753e61-iptables-alerter-script\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.033096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.032983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e75d46f-5528-40c8-8331-1d417012fcde-agent-certs\") pod \"konnectivity-agent-4j6r9\" (UID: \"4e75d46f-5528-40c8-8331-1d417012fcde\") " pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:13.033096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75deb2a9-94d0-47db-8a2b-2573142d1793-serviceca\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.033096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:13.033096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-cnibin\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.033096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-device-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-modprobe-d\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysconfig\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f258ff70-29a5-4705-9d44-4b57051cd060-cni-binary-copy\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-etc-kubernetes\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-os-release\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-run-netns\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-var-lib-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysctl-d\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdhlt\" (UniqueName: \"kubernetes.io/projected/cb97ce61-1167-4141-944b-bd2b1d5755ec-kube-api-access-hdhlt\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-sys\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033358 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysconfig\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-log-socket\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-log-socket\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5zq\" (UniqueName: \"kubernetes.io/projected/75deb2a9-94d0-47db-8a2b-2573142d1793-kube-api-access-gp5zq\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-k8s-cni-cncf-io\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-device-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033565 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-sys\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b571422-0e25-476f-b64d-4d20b0753e61-iptables-alerter-script\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-multus-certs\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-run\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-run-netns\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033705 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-var-lib-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-lib-modules\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.033776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033768 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-run\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-etc-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysctl-d\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-cni-bin\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-etc-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovn-node-metrics-cert\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-lib-modules\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-dbus\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-cni-bin\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-modprobe-d\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.033983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-socket-dir-parent\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-netns\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77b11a4-7705-45bd-8949-a8ad593cc39f-tmp\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ks58\" (UniqueName: \"kubernetes.io/projected/0b571422-0e25-476f-b64d-4d20b0753e61-kube-api-access-7ks58\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f258ff70-29a5-4705-9d44-4b57051cd060-multus-daemon-config\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrl94\" (UniqueName: \"kubernetes.io/projected/83915597-5417-4f08-b808-4faa9821ede0-kube-api-access-zrl94\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-sys-fs\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.034495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d5ecfd-006a-4b61-accc-df6012082fe4-tmp-dir\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-sys-fs\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-systemd\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-cni-netd\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovnkube-config\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75deb2a9-94d0-47db-8a2b-2573142d1793-host\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-cni-bin\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-systemd\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-kubelet\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d5ecfd-006a-4b61-accc-df6012082fe4-tmp-dir\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034862 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-cni-netd\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-system-cni-dir\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-openvswitch\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.035236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-ovn\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-run-ovn\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.034989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-socket-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-slash\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-os-release\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-slash\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-systemd\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035131 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-systemd\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-tuned\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-socket-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljjdl\" (UniqueName: \"kubernetes.io/projected/d77b11a4-7705-45bd-8949-a8ad593cc39f-kube-api-access-ljjdl\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-kubelet-config\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-cni-multus\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-host\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-node-log\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b571422-0e25-476f-b64d-4d20b0753e61-host-slash\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-conf-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovnkube-config\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035413 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjlrr\" (UniqueName: \"kubernetes.io/projected/f258ff70-29a5-4705-9d44-4b57051cd060-kube-api-access-zjlrr\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-node-log\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035496 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b571422-0e25-476f-b64d-4d20b0753e61-host-slash\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysctl-conf\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-host\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-var-lib-kubelet\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6l8n\" (UniqueName: \"kubernetes.io/projected/42d5ecfd-006a-4b61-accc-df6012082fe4-kube-api-access-n6l8n\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035579 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-var-lib-kubelet\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-hostroot\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-cnibin\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035613 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-sysctl-conf\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035627 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.036716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-registration-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-registration-dir\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42d5ecfd-006a-4b61-accc-df6012082fe4-hosts-file\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e75d46f-5528-40c8-8331-1d417012fcde-konnectivity-ca\") pod \"konnectivity-agent-4j6r9\" (UID: \"4e75d46f-5528-40c8-8331-1d417012fcde\") " pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035855 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb97ce61-1167-4141-944b-bd2b1d5755ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-cni-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42d5ecfd-006a-4b61-accc-df6012082fe4-hosts-file\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-kubelet\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-kubernetes\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.035990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovnkube-script-lib\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pjpv\" (UniqueName: \"kubernetes.io/projected/f19729ea-10f4-45f7-b59c-a13d03459cc6-kube-api-access-7pjpv\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-host-kubelet\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fx6j\" (UniqueName: \"kubernetes.io/projected/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-kube-api-access-7fx6j\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-system-cni-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.037355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-systemd-units\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-env-overrides\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-kubernetes\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e75d46f-5528-40c8-8331-1d417012fcde-konnectivity-ca\") pod \"konnectivity-agent-4j6r9\" (UID: \"4e75d46f-5528-40c8-8331-1d417012fcde\") " pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036448 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f19729ea-10f4-45f7-b59c-a13d03459cc6-systemd-units\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-env-overrides\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.036847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovnkube-script-lib\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.037378 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77b11a4-7705-45bd-8949-a8ad593cc39f-tmp\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.037662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f19729ea-10f4-45f7-b59c-a13d03459cc6-ovn-node-metrics-cert\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.038084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.037819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d77b11a4-7705-45bd-8949-a8ad593cc39f-etc-tuned\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.038388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.038136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e75d46f-5528-40c8-8331-1d417012fcde-agent-certs\") pod \"konnectivity-agent-4j6r9\" (UID: \"4e75d46f-5528-40c8-8331-1d417012fcde\") " pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:13.045028 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.045010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdhlt\" (UniqueName: \"kubernetes.io/projected/cb97ce61-1167-4141-944b-bd2b1d5755ec-kube-api-access-hdhlt\") pod \"aws-ebs-csi-driver-node-h4kxv\" (UID: \"cb97ce61-1167-4141-944b-bd2b1d5755ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.045144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.045125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pjpv\" (UniqueName: \"kubernetes.io/projected/f19729ea-10f4-45f7-b59c-a13d03459cc6-kube-api-access-7pjpv\") pod \"ovnkube-node-s8xwv\" (UID: \"f19729ea-10f4-45f7-b59c-a13d03459cc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.045351 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.045329 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ks58\" (UniqueName: \"kubernetes.io/projected/0b571422-0e25-476f-b64d-4d20b0753e61-kube-api-access-7ks58\") pod \"iptables-alerter-h59cl\" (UID: \"0b571422-0e25-476f-b64d-4d20b0753e61\") " pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.045911 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.045892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6l8n\" (UniqueName: \"kubernetes.io/projected/42d5ecfd-006a-4b61-accc-df6012082fe4-kube-api-access-n6l8n\") pod \"node-resolver-fjhsn\" (UID: \"42d5ecfd-006a-4b61-accc-df6012082fe4\") " pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.046134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.046117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljjdl\" (UniqueName: \"kubernetes.io/projected/d77b11a4-7705-45bd-8949-a8ad593cc39f-kube-api-access-ljjdl\") pod \"tuned-fqnj6\" (UID: \"d77b11a4-7705-45bd-8949-a8ad593cc39f\") " pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.137055 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-os-release\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137055 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-kubelet-config\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-cni-multus\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-conf-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137162 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-os-release\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlrr\" (UniqueName: \"kubernetes.io/projected/f258ff70-29a5-4705-9d44-4b57051cd060-kube-api-access-zjlrr\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.137199 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-hostroot\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137242 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-kubelet-config\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-cnibin\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.137260 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.137270 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:27:13.637253935 +0000 UTC m=+3.040602585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-cnibin\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137401 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-cni-multus\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-cni-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fx6j\" (UniqueName: \"kubernetes.io/projected/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-kube-api-access-7fx6j\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-hostroot\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-system-cni-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75deb2a9-94d0-47db-8a2b-2573142d1793-serviceca\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-cni-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-cnibin\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f258ff70-29a5-4705-9d44-4b57051cd060-cni-binary-copy\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137590 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-conf-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-etc-kubernetes\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-os-release\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5zq\" (UniqueName: \"kubernetes.io/projected/75deb2a9-94d0-47db-8a2b-2573142d1793-kube-api-access-gp5zq\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-k8s-cni-cncf-io\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.137907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-multus-certs\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-dbus\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-socket-dir-parent\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-netns\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f258ff70-29a5-4705-9d44-4b57051cd060-multus-daemon-config\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrl94\" (UniqueName: \"kubernetes.io/projected/83915597-5417-4f08-b808-4faa9821ede0-kube-api-access-zrl94\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75deb2a9-94d0-47db-8a2b-2573142d1793-host\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-cni-bin\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-cni-bin\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-kubelet\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-system-cni-dir\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.137991 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-system-cni-dir\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.137995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75deb2a9-94d0-47db-8a2b-2573142d1793-serviceca\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.138703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-cnibin\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.138032 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:27:13.638020789 +0000 UTC m=+3.041369438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-multus-certs\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138124 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-os-release\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138155 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-etc-kubernetes\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138085 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75deb2a9-94d0-47db-8a2b-2573142d1793-host\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-system-cni-dir\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-var-lib-kubelet\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-dbus\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138270 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-multus-socket-dir-parent\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138316 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-netns\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83915597-5417-4f08-b808-4faa9821ede0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138404 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f258ff70-29a5-4705-9d44-4b57051cd060-host-run-k8s-cni-cncf-io\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83915597-5417-4f08-b808-4faa9821ede0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f258ff70-29a5-4705-9d44-4b57051cd060-cni-binary-copy\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.139300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.138537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f258ff70-29a5-4705-9d44-4b57051cd060-multus-daemon-config\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.143698 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.143668 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:13.143698 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.143700 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:13.143856 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.143715 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:13.143856 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.143775 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:27:13.64376337 +0000 UTC m=+3.047112020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:13.146295 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.146219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fx6j\" (UniqueName: \"kubernetes.io/projected/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-kube-api-access-7fx6j\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:13.146512 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.146489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjlrr\" (UniqueName: \"kubernetes.io/projected/f258ff70-29a5-4705-9d44-4b57051cd060-kube-api-access-zjlrr\") pod \"multus-lftfj\" (UID: \"f258ff70-29a5-4705-9d44-4b57051cd060\") " pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.146818 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.146797 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5zq\" (UniqueName: \"kubernetes.io/projected/75deb2a9-94d0-47db-8a2b-2573142d1793-kube-api-access-gp5zq\") pod \"node-ca-zf7mk\" (UID: \"75deb2a9-94d0-47db-8a2b-2573142d1793\") " pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.146904 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.146800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrl94\" (UniqueName: \"kubernetes.io/projected/83915597-5417-4f08-b808-4faa9821ede0-kube-api-access-zrl94\") pod \"multus-additional-cni-plugins-2wqk7\" (UID: \"83915597-5417-4f08-b808-4faa9821ede0\") " pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.221815 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.221780 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fjhsn" Jun 07 16:27:13.228894 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.228877 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:13.240685 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.240668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h59cl" Jun 07 16:27:13.244178 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.244158 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:13.250809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.250791 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" Jun 07 16:27:13.256210 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.256195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" Jun 07 16:27:13.260677 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.260662 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:13.261709 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.261692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf7mk" Jun 07 16:27:13.268311 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.268295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lftfj" Jun 07 16:27:13.272902 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.272887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" Jun 07 16:27:13.382736 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.382707 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:13.641362 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.641331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:13.641551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.641406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:13.641551 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.641501 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:13.641669 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.641567 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:27:14.641546844 +0000 UTC m=+4.044895524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:13.641669 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.641505 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:13.641669 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.641622 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:27:14.641609808 +0000 UTC m=+4.044958460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:13.739710 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.739615 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb97ce61_1167_4141_944b_bd2b1d5755ec.slice/crio-fa9c7f5412823bdce9c434e2e4e6ff77e50d6b910e984cefa0b74b661a7b39d1 WatchSource:0}: Error finding container fa9c7f5412823bdce9c434e2e4e6ff77e50d6b910e984cefa0b74b661a7b39d1: Status 404 returned error can't find the container with id fa9c7f5412823bdce9c434e2e4e6ff77e50d6b910e984cefa0b74b661a7b39d1 Jun 07 16:27:13.741208 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.741186 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77b11a4_7705_45bd_8949_a8ad593cc39f.slice/crio-23787ac7e56d45b9d1bec819be8e39d3a82acb9675c8481eadacce17f4e0dbd0 WatchSource:0}: Error finding container 23787ac7e56d45b9d1bec819be8e39d3a82acb9675c8481eadacce17f4e0dbd0: Status 404 returned error can't find the container with id 23787ac7e56d45b9d1bec819be8e39d3a82acb9675c8481eadacce17f4e0dbd0 Jun 07 16:27:13.741695 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.741671 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75deb2a9_94d0_47db_8a2b_2573142d1793.slice/crio-ce5ff2401cc1d2bd9d673b4845ca97a4e1298d537a5b66c161cdfe51afc00118 WatchSource:0}: Error finding container ce5ff2401cc1d2bd9d673b4845ca97a4e1298d537a5b66c161cdfe51afc00118: Status 404 returned error can't find the container with id ce5ff2401cc1d2bd9d673b4845ca97a4e1298d537a5b66c161cdfe51afc00118 Jun 07 16:27:13.741800 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.741715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:13.741918 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.741875 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:13.741918 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.741896 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:13.741918 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.741908 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:13.742057 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:13.741959 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:27:14.741941102 +0000 UTC m=+4.145289754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:13.744171 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.744147 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19729ea_10f4_45f7_b59c_a13d03459cc6.slice/crio-3d568dd17bb9946b7bc3c7ad177c8b28e6f348006071fbe76d9f051648223fdc WatchSource:0}: Error finding container 3d568dd17bb9946b7bc3c7ad177c8b28e6f348006071fbe76d9f051648223fdc: Status 404 returned error can't find the container with id 3d568dd17bb9946b7bc3c7ad177c8b28e6f348006071fbe76d9f051648223fdc Jun 07 16:27:13.752700 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.752677 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf258ff70_29a5_4705_9d44_4b57051cd060.slice/crio-d66e61c44865ffbeeaa7e99f13726439b74ee511db5c14be0cc5ef0a41e68611 WatchSource:0}: Error finding container d66e61c44865ffbeeaa7e99f13726439b74ee511db5c14be0cc5ef0a41e68611: Status 404 returned error can't find the container with id d66e61c44865ffbeeaa7e99f13726439b74ee511db5c14be0cc5ef0a41e68611 Jun 07 16:27:13.774338 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.774315 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b571422_0e25_476f_b64d_4d20b0753e61.slice/crio-1cf5816f06e259ec147b556bd88dd4dee138dfd6ab78d0cf4043d163e5f0c0c4 WatchSource:0}: Error finding container 1cf5816f06e259ec147b556bd88dd4dee138dfd6ab78d0cf4043d163e5f0c0c4: Status 404 returned error can't find the container with id 1cf5816f06e259ec147b556bd88dd4dee138dfd6ab78d0cf4043d163e5f0c0c4 Jun 07 16:27:13.775065 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.775043 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e75d46f_5528_40c8_8331_1d417012fcde.slice/crio-a22bb79c8050dece549b4c0ea4450ede7cdd267324e8f98be0e9b680764f2471 WatchSource:0}: Error finding container a22bb79c8050dece549b4c0ea4450ede7cdd267324e8f98be0e9b680764f2471: Status 404 returned error can't find the container with id a22bb79c8050dece549b4c0ea4450ede7cdd267324e8f98be0e9b680764f2471 Jun 07 16:27:13.775820 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:13.775799 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d5ecfd_006a_4b61_accc_df6012082fe4.slice/crio-6f5246d61158ef7d8af373041e8b02ea020ab647592e3c42a92ddf92e4b62235 WatchSource:0}: Error finding container 6f5246d61158ef7d8af373041e8b02ea020ab647592e3c42a92ddf92e4b62235: Status 404 returned error can't find the container with id 6f5246d61158ef7d8af373041e8b02ea020ab647592e3c42a92ddf92e4b62235 Jun 07 16:27:13.961504 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.961425 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 16:22:12 +0000 UTC" deadline="2027-12-04 18:26:44.949147341 +0000 UTC" Jun 07 16:27:13.961504 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.961452 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13081h59m30.987698114s" Jun 07 16:27:13.997055 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.997020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fjhsn" event={"ID":"42d5ecfd-006a-4b61-accc-df6012082fe4","Type":"ContainerStarted","Data":"6f5246d61158ef7d8af373041e8b02ea020ab647592e3c42a92ddf92e4b62235"} Jun 07 16:27:13.998540 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.998508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h59cl" event={"ID":"0b571422-0e25-476f-b64d-4d20b0753e61","Type":"ContainerStarted","Data":"1cf5816f06e259ec147b556bd88dd4dee138dfd6ab78d0cf4043d163e5f0c0c4"} Jun 07 16:27:13.999671 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:13.999646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerStarted","Data":"14de8199dfa0c4e9c82841f5fa9dab45615c291a1cfb3123a182c483d675d05e"} Jun 07 16:27:14.000845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.000767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"3d568dd17bb9946b7bc3c7ad177c8b28e6f348006071fbe76d9f051648223fdc"} Jun 07 16:27:14.001922 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.001898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" event={"ID":"cb97ce61-1167-4141-944b-bd2b1d5755ec","Type":"ContainerStarted","Data":"fa9c7f5412823bdce9c434e2e4e6ff77e50d6b910e984cefa0b74b661a7b39d1"} Jun 07 16:27:14.003662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.003601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" event={"ID":"a0b78fd36e18c240d772fa14def0768e","Type":"ContainerStarted","Data":"6eddc96b1ff466f74e7d805ac7372f5af5126ae0c240d6bc6f4635ecfc8ca06a"} Jun 07 16:27:14.005325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.005296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4j6r9" event={"ID":"4e75d46f-5528-40c8-8331-1d417012fcde","Type":"ContainerStarted","Data":"a22bb79c8050dece549b4c0ea4450ede7cdd267324e8f98be0e9b680764f2471"} Jun 07 16:27:14.007434 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.007414 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf7mk" event={"ID":"75deb2a9-94d0-47db-8a2b-2573142d1793","Type":"ContainerStarted","Data":"ce5ff2401cc1d2bd9d673b4845ca97a4e1298d537a5b66c161cdfe51afc00118"} Jun 07 16:27:14.009159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.009137 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lftfj" event={"ID":"f258ff70-29a5-4705-9d44-4b57051cd060","Type":"ContainerStarted","Data":"d66e61c44865ffbeeaa7e99f13726439b74ee511db5c14be0cc5ef0a41e68611"} Jun 07 16:27:14.011411 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.011395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" event={"ID":"d77b11a4-7705-45bd-8949-a8ad593cc39f","Type":"ContainerStarted","Data":"23787ac7e56d45b9d1bec819be8e39d3a82acb9675c8481eadacce17f4e0dbd0"} Jun 07 16:27:14.017493 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.017448 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-26.ec2.internal" podStartSLOduration=2.017433633 podStartE2EDuration="2.017433633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:14.017191389 +0000 UTC m=+3.420540059" watchObservedRunningTime="2026-06-07 16:27:14.017433633 +0000 UTC m=+3.420782304" Jun 07 16:27:14.647647 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.647584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:14.647812 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.647679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:14.647981 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.647811 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:14.647981 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.647873 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:27:16.647855495 +0000 UTC m=+6.051204161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:14.648272 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.648251 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:14.648362 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.648309 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:27:16.648293942 +0000 UTC m=+6.051642592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:14.748226 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.748146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:14.748490 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.748322 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:14.748490 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.748345 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:14.748490 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.748358 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:14.748490 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.748411 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:27:16.748394909 +0000 UTC m=+6.151743565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:14.962647 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.962517 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 16:22:12 +0000 UTC" deadline="2028-02-08 23:08:27.035649438 +0000 UTC" Jun 07 16:27:14.962647 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.962583 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14670h41m12.073070557s" Jun 07 16:27:14.990866 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.990798 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:14.991085 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.990928 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:14.991318 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.991297 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:14.991404 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.991386 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:14.991456 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:14.991442 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:14.991524 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:14.991508 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:15.028662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:15.027928 2561 generic.go:356] "Generic (PLEG): container finished" podID="668b873de835fc263231a6f5c348c49b" containerID="015c61fe481ccdc4f69eac738e1d75b04aed33a40d756ba29a80a99692cccfbf" exitCode=0 Jun 07 16:27:15.028923 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:15.028830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" event={"ID":"668b873de835fc263231a6f5c348c49b","Type":"ContainerDied","Data":"015c61fe481ccdc4f69eac738e1d75b04aed33a40d756ba29a80a99692cccfbf"} Jun 07 16:27:16.058215 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.058183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" event={"ID":"668b873de835fc263231a6f5c348c49b","Type":"ContainerStarted","Data":"cd8b11d494cc4870612419656f93133237d45693cf02b30f97e44c89980d3d02"} Jun 07 16:27:16.077275 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.076913 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-26.ec2.internal" podStartSLOduration=4.076894351 podStartE2EDuration="4.076894351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:16.075944246 +0000 UTC m=+5.479292934" watchObservedRunningTime="2026-06-07 16:27:16.076894351 +0000 UTC m=+5.480243021" Jun 07 16:27:16.663062 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.663023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:16.663227 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.663104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:16.663301 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.663237 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:16.663301 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.663297 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:27:20.663279503 +0000 UTC m=+10.066628157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:16.663705 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.663684 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:16.663827 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.663742 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:27:20.663725733 +0000 UTC m=+10.067074385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:16.764256 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.764217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:16.764430 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.764411 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:16.764430 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.764429 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:16.764530 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.764441 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:16.764530 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.764496 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:27:20.764478328 +0000 UTC m=+10.167826980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:16.990714 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.989646 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:16.990714 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.989750 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:16.990714 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.990032 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:16.990714 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.990088 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:16.990714 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:16.990123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:16.990714 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:16.990195 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:18.988694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:18.988657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:18.989200 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:18.988803 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:18.989200 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:18.989130 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:18.989200 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:18.989190 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:18.989392 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:18.989320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:18.989463 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:18.989404 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:20.699085 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:20.699055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:20.699517 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:20.699106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:20.699517 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.699218 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:20.699517 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.699230 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:20.699517 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.699270 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:27:28.699257357 +0000 UTC m=+18.102606006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:20.699517 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.699284 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:27:28.699278369 +0000 UTC m=+18.102627023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:20.799677 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:20.799648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:20.799839 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.799824 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:20.799885 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.799843 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:20.799885 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.799852 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:20.799951 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.799894 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:27:28.799880949 +0000 UTC m=+18.203229598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:20.991382 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:20.991361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:20.991535 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.991465 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:20.991857 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:20.991834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:20.991960 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.991923 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:20.992028 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:20.991971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:20.992081 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:20.992052 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:22.989278 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:22.989084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:22.989676 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:22.989115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:22.989676 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:22.989362 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:22.989676 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:22.989138 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:22.990218 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:22.989912 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:22.990218 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:22.989749 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:24.989451 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:24.989367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:24.989896 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:24.989489 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:24.989896 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:24.989385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:24.989896 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:24.989517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:24.989896 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:24.989574 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:24.989896 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:24.989651 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:26.988669 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:26.988331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:26.988669 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:26.988360 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:26.988669 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:26.988340 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:26.988669 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:26.988435 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:26.988669 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:26.988525 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:26.988669 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:26.988611 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:28.762653 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:28.762598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:28.763108 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:28.762689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:28.763108 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.762759 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:28.763108 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.762821 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:28.763108 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.762829 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:27:44.762806611 +0000 UTC m=+34.166155270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:28.763108 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.762871 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:27:44.762855076 +0000 UTC m=+34.166203725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:28.863368 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:28.863337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:28.863525 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.863464 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:28.863525 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.863490 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:28.863525 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.863499 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:28.863715 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.863553 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:27:44.863540116 +0000 UTC m=+34.266888765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:28.988915 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:28.988883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:28.989084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:28.988894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:28.989084 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.989001 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:28.989084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:28.989037 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:28.989228 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.989134 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:28.989270 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:28.989221 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:30.989854 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:30.989826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:30.990329 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:30.989865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:30.990329 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:30.989920 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:30.990329 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:30.989966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:30.990329 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:30.990008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:30.990329 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:30.990090 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:32.988544 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:32.988414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:32.989139 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:32.988621 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:32.989139 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:32.988416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:32.989139 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:32.988705 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:32.989139 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:32.988416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:32.989139 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:32.988760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:33.092159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.092131 2561 generic.go:356] "Generic (PLEG): container finished" podID="83915597-5417-4f08-b808-4faa9821ede0" containerID="61fb629e8b07f24ad4afdeb56dbbaf439e922474db1a2db1e6778939933d7b83" exitCode=0 Jun 07 16:27:33.092402 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.092368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerDied","Data":"61fb629e8b07f24ad4afdeb56dbbaf439e922474db1a2db1e6778939933d7b83"} Jun 07 16:27:33.094481 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.094454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"a536e424397f0ae02be30747cfaf76fe21edbcc9e256d2351609e2452f223b44"} Jun 07 16:27:33.094566 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.094521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"22517b30503bdd989ad15e5bdd1bf9177a4feafa76b374a3aa469fbf3100eabd"} Jun 07 16:27:33.094566 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.094552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"d86da452fae02a8c94bc0249ec2aa617e5ecaa34dbf0a04eb355cf1c695269fe"} Jun 07 16:27:33.096093 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.096067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" event={"ID":"cb97ce61-1167-4141-944b-bd2b1d5755ec","Type":"ContainerStarted","Data":"c89ec1c17b90ee9aae739e41ec146da37049099c39f6fbd4492358e0ff90933e"} Jun 07 16:27:33.099548 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.099506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4j6r9" event={"ID":"4e75d46f-5528-40c8-8331-1d417012fcde","Type":"ContainerStarted","Data":"74abc13f189b62507bf469d2aae2ffaba261634fdbcb6b7623c1683352a9fbe2"} Jun 07 16:27:33.101240 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.101166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf7mk" event={"ID":"75deb2a9-94d0-47db-8a2b-2573142d1793","Type":"ContainerStarted","Data":"20c846a9b659f336dd8e2e23bdc566817fe5719b5008f9b857e912e96bfde8de"} Jun 07 16:27:33.102394 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.102374 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lftfj" event={"ID":"f258ff70-29a5-4705-9d44-4b57051cd060","Type":"ContainerStarted","Data":"c6f004810a5f6ef575855dbce76cae94d511a0535944e8089540363faef7b456"} Jun 07 16:27:33.103748 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.103723 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" event={"ID":"d77b11a4-7705-45bd-8949-a8ad593cc39f","Type":"ContainerStarted","Data":"3ed5735a23aec3ad2b9e078360a87503c98986f57d0699f307900acaa12c7579"} Jun 07 16:27:33.105140 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.105119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fjhsn" event={"ID":"42d5ecfd-006a-4b61-accc-df6012082fe4","Type":"ContainerStarted","Data":"0e0c833964f6013f0f127e98aa59497bbf0b6e8ecb5bfd837927631f88cab953"} Jun 07 16:27:33.127482 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.127447 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lftfj" podStartSLOduration=3.09540495 podStartE2EDuration="22.127435557s" totalImagesPullingTime="19.032030607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:33.127144004 +0000 UTC m=+22.530492673" watchObservedRunningTime="2026-06-07 16:27:33.127435557 +0000 UTC m=+22.530784228" Jun 07 16:27:33.140774 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.140739 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4j6r9" podStartSLOduration=7.708955208 podStartE2EDuration="22.14072752s" totalImagesPullingTime="14.431772312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:33.14036161 +0000 UTC m=+22.543710291" watchObservedRunningTime="2026-06-07 16:27:33.14072752 +0000 UTC m=+22.544076189" Jun 07 16:27:33.155593 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.155561 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fqnj6" podStartSLOduration=3.201664355 podStartE2EDuration="22.155550909s" totalImagesPullingTime="18.953886554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:33.15519719 +0000 UTC m=+22.558545861" watchObservedRunningTime="2026-06-07 16:27:33.155550909 +0000 UTC m=+22.558899579" Jun 07 16:27:33.169789 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.169757 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zf7mk" podStartSLOduration=3.218282903 podStartE2EDuration="22.169747459s" totalImagesPullingTime="18.951464556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:33.16944243 +0000 UTC m=+22.572791102" watchObservedRunningTime="2026-06-07 16:27:33.169747459 +0000 UTC m=+22.573096129" Jun 07 16:27:33.187310 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:33.187277 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fjhsn" podStartSLOduration=3.28534407 podStartE2EDuration="22.187266151s" totalImagesPullingTime="18.901922081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:33.187189026 +0000 UTC m=+22.590537697" watchObservedRunningTime="2026-06-07 16:27:33.187266151 +0000 UTC m=+22.590614820" Jun 07 16:27:34.110232 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.109993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"bd3c342b4095f33439be3f6b90e41e2bfb959b55e9739ce09db0e1a463b932a2"} Jun 07 16:27:34.110823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.110364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"497747e9f52a09769998c08f4e4fa96867d6915490479ef38c9dd14aa6e70c57"} Jun 07 16:27:34.110823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.110423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"78496eb2e80e89d8e759b4dc49fa4569d885e5e2b564d39074fe819471044ab6"} Jun 07 16:27:34.295349 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.295314 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 16:27:34.988922 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.988821 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T16:27:34.295330532Z","UUID":"f53b7d70-9015-4b50-9649-6233abf000dc","Handler":null,"Name":"","Endpoint":""} Jun 07 16:27:34.989184 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.988953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:34.989184 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.988956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:34.989184 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:34.989055 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:34.989184 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:34.989143 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:34.989184 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.989169 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:34.989390 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:34.989260 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:34.990875 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.990733 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 16:27:34.990875 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:34.990798 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 16:27:35.115270 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:35.115240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h59cl" event={"ID":"0b571422-0e25-476f-b64d-4d20b0753e61","Type":"ContainerStarted","Data":"29c974eb624c791be7ff1d44f6a4f291dc4415ee2bf9b0554bc299900a7aa55d"} Jun 07 16:27:35.117249 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:35.117224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" event={"ID":"cb97ce61-1167-4141-944b-bd2b1d5755ec","Type":"ContainerStarted","Data":"f795b3119aa8af71fafeb99dc04ad375ece24373a3d75184e60bbee4043849e0"} Jun 07 16:27:35.129909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:35.129860 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h59cl" podStartSLOduration=5.21296351 podStartE2EDuration="24.129845719s" totalImagesPullingTime="18.916882209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:35.129132356 +0000 UTC m=+24.532481028" watchObservedRunningTime="2026-06-07 16:27:35.129845719 +0000 UTC m=+24.533194391" Jun 07 16:27:36.125553 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:36.125515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"edc0898f1d0238c830b3fbc05018e1463e31e41a8393a4b6fc13a12488c67de7"} Jun 07 16:27:36.127778 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:36.127737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" event={"ID":"cb97ce61-1167-4141-944b-bd2b1d5755ec","Type":"ContainerStarted","Data":"4bdf9b3be1073b3b44ba9a63eee5066d8867ac6be3e31f357fe1550609f33aeb"} Jun 07 16:27:36.145752 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:36.145709 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4kxv" podStartSLOduration=4.073349154 podStartE2EDuration="25.145695823s" totalImagesPullingTime="21.072346669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:36.145089195 +0000 UTC m=+25.548437866" watchObservedRunningTime="2026-06-07 16:27:36.145695823 +0000 UTC m=+25.549044493" Jun 07 16:27:36.988807 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:36.988775 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:36.988968 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:36.988782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:36.988968 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:36.988870 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:36.989083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:36.988988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:36.989083 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:36.988992 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:36.989175 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:36.989110 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:37.316256 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:37.316231 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:37.401294 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:37.401276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:38.064436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.064275 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:38.064946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.064932 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:38.134077 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.134051 2561 generic.go:356] "Generic (PLEG): container finished" podID="83915597-5417-4f08-b808-4faa9821ede0" containerID="9049344198bef18ae0261b56621825d118abba590b8e9165ec61a85227aae33f" exitCode=0 Jun 07 16:27:38.134207 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.134124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerDied","Data":"9049344198bef18ae0261b56621825d118abba590b8e9165ec61a85227aae33f"} Jun 07 16:27:38.137970 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.137953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" event={"ID":"f19729ea-10f4-45f7-b59c-a13d03459cc6","Type":"ContainerStarted","Data":"22ad4fa74894355f7e1a3755cca2b87b44f8e96e5683043d2ce4f464d4af19d6"} Jun 07 16:27:38.138130 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.138113 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:38.138208 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.138150 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:38.138208 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.138190 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:38.138491 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.138475 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4j6r9" Jun 07 16:27:38.154336 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.154319 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:38.183181 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.182349 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" podStartSLOduration=8.187895301 podStartE2EDuration="27.182332631s" totalImagesPullingTime="18.99443733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:38.181287761 +0000 UTC m=+27.584636433" watchObservedRunningTime="2026-06-07 16:27:38.182332631 +0000 UTC m=+27.585681302" Jun 07 16:27:38.244438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.244418 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:38.989246 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.989221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:38.989775 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.989221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:38.989775 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:38.989317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:38.989775 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:38.989314 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:38.989775 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:38.989418 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:38.989775 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:38.989499 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:39.141113 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.141091 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:39.155175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.155154 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:27:39.804336 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.804163 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t4z6n"] Jun 07 16:27:39.804495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.804403 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:39.804546 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:39.804493 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:39.806878 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.806849 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49x6l"] Jun 07 16:27:39.806987 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.806927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:39.807026 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:39.806998 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:39.815876 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.815851 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hs6wc"] Jun 07 16:27:39.815971 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:39.815922 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:39.816015 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:39.815990 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:40.146977 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:40.146944 2561 generic.go:356] "Generic (PLEG): container finished" podID="83915597-5417-4f08-b808-4faa9821ede0" containerID="1ae5d58a9aaaa734aca37c74534421c577953b97a810c6b3b1917d79be786903" exitCode=0 Jun 07 16:27:40.147455 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:40.147026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerDied","Data":"1ae5d58a9aaaa734aca37c74534421c577953b97a810c6b3b1917d79be786903"} Jun 07 16:27:40.989292 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:40.989260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:40.989459 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:40.989369 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:40.989459 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:40.989373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:40.989459 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:40.989431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:41.051465 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:41.051441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:41.159816 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:41.159787 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:41.209496 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:41.209461 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:41.791401 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:41.791373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:41.891355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:41.891282 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:41.988609 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:41.988589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:41.988739 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:41.988695 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:42.154317 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:42.154256 2561 generic.go:356] "Generic (PLEG): container finished" podID="83915597-5417-4f08-b808-4faa9821ede0" containerID="2e3d89025140fe7c351da6afcec779f0b16966e33f99de67ea97044cb4803187" exitCode=0 Jun 07 16:27:42.154317 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:42.154307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerDied","Data":"2e3d89025140fe7c351da6afcec779f0b16966e33f99de67ea97044cb4803187"} Jun 07 16:27:42.989284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:42.989253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:42.989898 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:42.989380 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:42.989898 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:42.989440 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:42.989898 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:42.989526 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:43.814261 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:43.814221 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:43.914337 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:43.914254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:43.988532 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:43.988502 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:43.988723 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:43.988619 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49x6l" podUID="315586b7-dc0b-49b0-aae8-19debbc1e2fd" Jun 07 16:27:44.767689 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.767654 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:44.783153 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.783132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:44.783290 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.783174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:44.783290 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.783283 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:44.783382 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.783334 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:28:16.78332025 +0000 UTC m=+66.186668900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:44.783382 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.783283 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:44.783485 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.783430 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret podName:b8443c72-de4d-4e14-a8cf-7ef18d57fd2c nodeName:}" failed. No retries permitted until 2026-06-07 16:28:16.783409134 +0000 UTC m=+66.186757797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret") pod "global-pull-secret-syncer-t4z6n" (UID: "b8443c72-de4d-4e14-a8cf-7ef18d57fd2c") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:44.868205 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.868165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:44.884490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.884463 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:44.884659 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.884594 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:44.884659 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.884612 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:44.884659 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.884622 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fnxgw for pod openshift-network-diagnostics/network-check-target-49x6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:44.884814 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.884709 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw podName:315586b7-dc0b-49b0-aae8-19debbc1e2fd nodeName:}" failed. No retries permitted until 2026-06-07 16:28:16.884687689 +0000 UTC m=+66.288036359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnxgw" (UniqueName: "kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw") pod "network-check-target-49x6l" (UID: "315586b7-dc0b-49b0-aae8-19debbc1e2fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:44.968245 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.968209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:44.988743 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.988709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:44.988905 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.988837 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4z6n" podUID="b8443c72-de4d-4e14-a8cf-7ef18d57fd2c" Jun 07 16:27:44.989334 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:44.989308 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:44.989451 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:44.989428 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:27:45.434063 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.433895 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-26.ec2.internal" event="NodeReady" Jun 07 16:27:45.434229 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.434179 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 16:27:45.475202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.474374 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hlb9x"] Jun 07 16:27:45.505247 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.505218 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b52tw"] Jun 07 16:27:45.505385 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.505337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.507740 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.507487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 16:27:45.507740 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.507509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 16:27:45.507740 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.507547 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bl7z8\"" Jun 07 16:27:45.519185 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.519164 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hlb9x"] Jun 07 16:27:45.519851 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.519200 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b52tw"] Jun 07 16:27:45.519851 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.519271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.521436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.521416 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8l4v2\"" Jun 07 16:27:45.521531 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.521471 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 16:27:45.521937 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.521918 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 16:27:45.522062 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.522002 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 16:27:45.590259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.590234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/452f1216-275f-4bf0-ba3f-5b713d478237-config-volume\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.590401 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.590314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lw4q\" (UniqueName: \"kubernetes.io/projected/452f1216-275f-4bf0-ba3f-5b713d478237-kube-api-access-6lw4q\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.590401 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.590341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452f1216-275f-4bf0-ba3f-5b713d478237-tmp-dir\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.590401 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.590387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.591234 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.591210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:45.691364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lw4q\" (UniqueName: \"kubernetes.io/projected/452f1216-275f-4bf0-ba3f-5b713d478237-kube-api-access-6lw4q\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.691511 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17513ad6-d53b-4329-92db-436f2f32d90d-cert\") pod \"ingress-canary-b52tw\" (UID: \"17513ad6-d53b-4329-92db-436f2f32d90d\") " pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.691511 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452f1216-275f-4bf0-ba3f-5b713d478237-tmp-dir\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.691511 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.691511 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzxfc\" (UniqueName: \"kubernetes.io/projected/17513ad6-d53b-4329-92db-436f2f32d90d-kube-api-access-mzxfc\") pod \"ingress-canary-b52tw\" (UID: \"17513ad6-d53b-4329-92db-436f2f32d90d\") " pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.691511 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/452f1216-275f-4bf0-ba3f-5b713d478237-config-volume\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.691924 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.691907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452f1216-275f-4bf0-ba3f-5b713d478237-tmp-dir\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.692005 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:45.691993 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:45.692038 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.692013 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/452f1216-275f-4bf0-ba3f-5b713d478237-config-volume\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.692038 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:45.692036 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:46.192022942 +0000 UTC m=+35.595371591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:27:45.695484 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.695455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:45.704145 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.704124 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lw4q\" (UniqueName: \"kubernetes.io/projected/452f1216-275f-4bf0-ba3f-5b713d478237-kube-api-access-6lw4q\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:45.792280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.792217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17513ad6-d53b-4329-92db-436f2f32d90d-cert\") pod \"ingress-canary-b52tw\" (UID: \"17513ad6-d53b-4329-92db-436f2f32d90d\") " pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.792714 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.792348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzxfc\" (UniqueName: \"kubernetes.io/projected/17513ad6-d53b-4329-92db-436f2f32d90d-kube-api-access-mzxfc\") pod \"ingress-canary-b52tw\" (UID: \"17513ad6-d53b-4329-92db-436f2f32d90d\") " pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.793464 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.793440 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:45.795242 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.795223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17513ad6-d53b-4329-92db-436f2f32d90d-cert\") pod \"ingress-canary-b52tw\" (UID: \"17513ad6-d53b-4329-92db-436f2f32d90d\") " pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.804284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.804244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzxfc\" (UniqueName: \"kubernetes.io/projected/17513ad6-d53b-4329-92db-436f2f32d90d-kube-api-access-mzxfc\") pod \"ingress-canary-b52tw\" (UID: \"17513ad6-d53b-4329-92db-436f2f32d90d\") " pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.828280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.828260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b52tw" Jun 07 16:27:45.893628 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.893600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:45.988599 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.988571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:27:45.991199 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.991177 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:27:45.991199 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.991200 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:27:45.991375 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:45.991238 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8469t\"" Jun 07 16:27:46.194963 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.194884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:46.195112 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:46.195024 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:46.195112 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:46.195096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:47.195078154 +0000 UTC m=+36.598426805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:27:46.549107 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.549077 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b52tw"] Jun 07 16:27:46.637415 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:27:46.637387 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17513ad6_d53b_4329_92db_436f2f32d90d.slice/crio-cf72b9b647ad0798d4f6a42f2841dc0f391daef8f8b7cb9e37bbe30803cadf9d WatchSource:0}: Error finding container cf72b9b647ad0798d4f6a42f2841dc0f391daef8f8b7cb9e37bbe30803cadf9d: Status 404 returned error can't find the container with id cf72b9b647ad0798d4f6a42f2841dc0f391daef8f8b7cb9e37bbe30803cadf9d Jun 07 16:27:46.760032 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.760011 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:46.988953 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.988900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:27:46.989233 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.989095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:27:46.993388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.993367 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:27:46.993497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.993431 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6ng2d\"" Jun 07 16:27:46.993567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:46.993550 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:27:47.166834 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:47.166580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b52tw" event={"ID":"17513ad6-d53b-4329-92db-436f2f32d90d","Type":"ContainerStarted","Data":"cf72b9b647ad0798d4f6a42f2841dc0f391daef8f8b7cb9e37bbe30803cadf9d"} Jun 07 16:27:47.169731 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:47.169692 2561 generic.go:356] "Generic (PLEG): container finished" podID="83915597-5417-4f08-b808-4faa9821ede0" containerID="7053c90b45ede3781b516a08b15e0a6a3ceb9220913a8f01c29aada2aeb99770" exitCode=0 Jun 07 16:27:47.169828 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:47.169738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerDied","Data":"7053c90b45ede3781b516a08b15e0a6a3ceb9220913a8f01c29aada2aeb99770"} Jun 07 16:27:47.213652 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:47.210157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:47.213652 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:47.210321 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:47.213652 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:47.210371 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:49.210355272 +0000 UTC m=+38.613703921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:27:48.175726 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:48.175691 2561 generic.go:356] "Generic (PLEG): container finished" podID="83915597-5417-4f08-b808-4faa9821ede0" containerID="4f7f7b0b532c83bcad89aa8d60c39c56e8ac5395471affe98afc2e4b443d9c0b" exitCode=0 Jun 07 16:27:48.176135 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:48.175756 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerDied","Data":"4f7f7b0b532c83bcad89aa8d60c39c56e8ac5395471affe98afc2e4b443d9c0b"} Jun 07 16:27:49.181315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.181279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" event={"ID":"83915597-5417-4f08-b808-4faa9821ede0","Type":"ContainerStarted","Data":"167404fdf673ac94cfb3953e927435777c3671b68bd00426830e24cb249bfd14"} Jun 07 16:27:49.182704 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.182680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b52tw" event={"ID":"17513ad6-d53b-4329-92db-436f2f32d90d","Type":"ContainerStarted","Data":"0b616b45553e04c7e319676bdd8953e8b7ece2de1ba4b3124806254e913a64dc"} Jun 07 16:27:49.206683 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.206646 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2wqk7" podStartSLOduration=8.344620137 podStartE2EDuration="38.206615998s" totalImagesPullingTime="29.861995861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:49.2065638 +0000 UTC m=+38.609912468" watchObservedRunningTime="2026-06-07 16:27:49.206615998 +0000 UTC m=+38.609964660" Jun 07 16:27:49.221218 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.221176 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b52tw" podStartSLOduration=2.615810743 podStartE2EDuration="4.221163231s" totalImagesPullingTime="1.605352488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:49.221058283 +0000 UTC m=+38.624406954" watchObservedRunningTime="2026-06-07 16:27:49.221163231 +0000 UTC m=+38.624511903" Jun 07 16:27:49.224290 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.224270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:49.224416 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:49.224398 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:49.224463 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:49.224453 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:53.224440932 +0000 UTC m=+42.627789581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:27:49.341065 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.341041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:49.438153 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.438091 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:49.933333 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:49.933297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:50.033909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:50.033884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:53.249695 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:53.249664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:27:53.250053 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:53.249759 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:53.250053 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:27:53.249803 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:01.249791081 +0000 UTC m=+50.653139731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:27:56.478443 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:56.478404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:27:56.532901 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:27:56.532879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:00.904509 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:00.904472 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:00.958456 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:00.958435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:01.303548 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:01.303521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:28:01.303772 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:01.303670 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:01.303772 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:01.303741 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:17.303724553 +0000 UTC m=+66.707073206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:28:01.583954 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:01.583884 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:01.635166 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:01.635139 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:03.754206 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:03.754178 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:03.854347 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:03.854321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:11.160083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:11.160059 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8xwv" Jun 07 16:28:11.305009 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:11.304980 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:11.350870 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:11.350840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:16.803250 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.803206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:28:16.803659 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.803273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:28:16.805578 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.805558 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:28:16.805692 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.805676 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:28:16.813544 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:16.813530 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:28:16.813593 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:16.813578 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:29:20.813563245 +0000 UTC m=+130.216911894 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : secret "metrics-daemon-secret" not found Jun 07 16:28:16.817056 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.817036 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8443c72-de4d-4e14-a8cf-7ef18d57fd2c-original-pull-secret\") pod \"global-pull-secret-syncer-t4z6n\" (UID: \"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c\") " pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:28:16.904056 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.904031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:28:16.906817 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.906801 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:28:16.916382 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.916365 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:28:16.927296 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:16.927274 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxgw\" (UniqueName: \"kubernetes.io/projected/315586b7-dc0b-49b0-aae8-19debbc1e2fd-kube-api-access-fnxgw\") pod \"network-check-target-49x6l\" (UID: \"315586b7-dc0b-49b0-aae8-19debbc1e2fd\") " pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:28:17.005411 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.005385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4z6n" Jun 07 16:28:17.119746 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.119706 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t4z6n"] Jun 07 16:28:17.123292 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:28:17.123270 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8443c72_de4d_4e14_a8cf_7ef18d57fd2c.slice/crio-443831cc02f9d2c9ae102551a415a8c63aeb9185d774fcfb9904cfd33be98d85 WatchSource:0}: Error finding container 443831cc02f9d2c9ae102551a415a8c63aeb9185d774fcfb9904cfd33be98d85: Status 404 returned error can't find the container with id 443831cc02f9d2c9ae102551a415a8c63aeb9185d774fcfb9904cfd33be98d85 Jun 07 16:28:17.201931 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.201907 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8469t\"" Jun 07 16:28:17.209972 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.209946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:28:17.246917 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.246884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t4z6n" event={"ID":"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c","Type":"ContainerStarted","Data":"443831cc02f9d2c9ae102551a415a8c63aeb9185d774fcfb9904cfd33be98d85"} Jun 07 16:28:17.306197 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.306173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:28:17.306313 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:17.306277 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:17.306364 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:17.306354 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:49.306330544 +0000 UTC m=+98.709679193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:28:17.325331 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:17.325293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49x6l"] Jun 07 16:28:17.330012 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:28:17.329991 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315586b7_dc0b_49b0_aae8_19debbc1e2fd.slice/crio-53f8580c77c7af72fdfe9f751dfce22cd5369d9a603e9eef1bcd3f23acc98041 WatchSource:0}: Error finding container 53f8580c77c7af72fdfe9f751dfce22cd5369d9a603e9eef1bcd3f23acc98041: Status 404 returned error can't find the container with id 53f8580c77c7af72fdfe9f751dfce22cd5369d9a603e9eef1bcd3f23acc98041 Jun 07 16:28:18.250470 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:18.250427 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49x6l" event={"ID":"315586b7-dc0b-49b0-aae8-19debbc1e2fd","Type":"ContainerStarted","Data":"53f8580c77c7af72fdfe9f751dfce22cd5369d9a603e9eef1bcd3f23acc98041"} Jun 07 16:28:22.261020 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:22.260981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49x6l" event={"ID":"315586b7-dc0b-49b0-aae8-19debbc1e2fd","Type":"ContainerStarted","Data":"aff648904ca6c6d80224e311e96896b9a4ab370647473cc0235387a5f7e23e7d"} Jun 07 16:28:22.261528 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:22.261047 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:28:22.262324 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:22.262302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t4z6n" event={"ID":"b8443c72-de4d-4e14-a8cf-7ef18d57fd2c","Type":"ContainerStarted","Data":"f8af98aefc53492d24e45b186f561b2c0aec5e8d51ffd6c3e1004df3f5dc7283"} Jun 07 16:28:22.276593 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:22.276545 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-49x6l" podStartSLOduration=67.078750906 podStartE2EDuration="1m11.276532295s" totalImagesPullingTime="4.197781389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:22.275870134 +0000 UTC m=+71.679218805" watchObservedRunningTime="2026-06-07 16:28:22.276532295 +0000 UTC m=+71.679880988" Jun 07 16:28:22.288704 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:22.288670 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t4z6n" podStartSLOduration=66.878682078 podStartE2EDuration="1m11.288652326s" totalImagesPullingTime="4.409970248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:22.288612077 +0000 UTC m=+71.691960762" watchObservedRunningTime="2026-06-07 16:28:22.288652326 +0000 UTC m=+71.692000994" Jun 07 16:28:23.840239 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:23.840211 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:23.893956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:23.893926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:23.943747 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:23.943721 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:28:49.310376 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:49.310343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:28:49.310747 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:49.310483 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:49.310747 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:28:49.310545 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:29:53.310530227 +0000 UTC m=+162.713878879 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:28:53.267159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:28:53.267128 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-49x6l" Jun 07 16:29:20.902982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:29:20.902926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:29:20.903452 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:29:20.903066 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:29:20.903452 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:29:20.903139 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs podName:dfea8106-9ac0-4427-a1f1-d94b5776d1ab nodeName:}" failed. No retries permitted until 2026-06-07 16:31:22.90312424 +0000 UTC m=+252.306472889 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs") pod "network-metrics-daemon-hs6wc" (UID: "dfea8106-9ac0-4427-a1f1-d94b5776d1ab") : secret "metrics-daemon-secret" not found Jun 07 16:29:48.515540 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:29:48.515502 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hlb9x" podUID="452f1216-275f-4bf0-ba3f-5b713d478237" Jun 07 16:29:49.453027 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:29:49.452997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlb9x" Jun 07 16:29:50.000794 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:29:50.000759 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hs6wc" podUID="dfea8106-9ac0-4427-a1f1-d94b5776d1ab" Jun 07 16:29:53.312464 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:29:53.312427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:29:53.312850 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:29:53.312532 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:29:53.312850 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:29:53.312580 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls podName:452f1216-275f-4bf0-ba3f-5b713d478237 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:55.312566839 +0000 UTC m=+284.715915488 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls") pod "dns-default-hlb9x" (UID: "452f1216-275f-4bf0-ba3f-5b713d478237") : secret "dns-default-metrics-tls" not found Jun 07 16:30:03.988595 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:03.988518 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:30:25.122415 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.122382 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz"] Jun 07 16:30:25.125141 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.125123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" Jun 07 16:30:25.127330 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.127312 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.127437 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.127365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-752sq\"" Jun 07 16:30:25.128400 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.128384 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.137596 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.137579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz"] Jun 07 16:30:25.216769 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.216744 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz"] Jun 07 16:30:25.219359 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.219346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.221512 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.221491 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 07 16:30:25.221617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.221535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 07 16:30:25.221617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.221536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbk7z\" (UniqueName: \"kubernetes.io/projected/22188524-497c-42cb-85c3-480ae1b6ab00-kube-api-access-wbk7z\") pod \"volume-data-source-validator-78dd696465-zw5mz\" (UID: \"22188524-497c-42cb-85c3-480ae1b6ab00\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" Jun 07 16:30:25.221617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.221562 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.221830 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.221817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8mdrj\"" Jun 07 16:30:25.221872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.221835 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.226492 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.226470 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8"] Jun 07 16:30:25.229479 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.229462 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-xn4mm"] Jun 07 16:30:25.229745 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.229728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.231906 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.231878 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9gznm\"" Jun 07 16:30:25.232198 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.232183 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 07 16:30:25.232495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.232473 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.232795 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.232775 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz"] Jun 07 16:30:25.233839 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.233819 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 07 16:30:25.233915 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.233851 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.234834 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.234812 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.237318 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.237298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 07 16:30:25.237414 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.237308 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.237414 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.237392 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vfk2w\"" Jun 07 16:30:25.237793 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.237776 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 07 16:30:25.238041 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.238025 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.239056 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.239039 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8"] Jun 07 16:30:25.242499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.242477 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-xn4mm"] Jun 07 16:30:25.243540 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.243519 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 07 16:30:25.319849 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.319828 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66c94685c9-rwhbx"] Jun 07 16:30:25.322315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.322315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtb5m\" (UniqueName: \"kubernetes.io/projected/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-kube-api-access-dtb5m\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.322462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbk7z\" (UniqueName: \"kubernetes.io/projected/22188524-497c-42cb-85c3-480ae1b6ab00-kube-api-access-wbk7z\") pod \"volume-data-source-validator-78dd696465-zw5mz\" (UID: \"22188524-497c-42cb-85c3-480ae1b6ab00\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" Jun 07 16:30:25.322462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8xsb\" (UniqueName: \"kubernetes.io/projected/a6b264de-e198-4442-b5a3-88b6d3d19e05-kube-api-access-v8xsb\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.322462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6b264de-e198-4442-b5a3-88b6d3d19e05-config\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.322462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.322462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b264de-e198-4442-b5a3-88b6d3d19e05-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.322653 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.322479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.325107 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.325087 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 16:30:25.325175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.325126 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8v6gq\"" Jun 07 16:30:25.325287 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.325271 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 16:30:25.325368 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.325281 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 16:30:25.330719 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.330701 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 16:30:25.331499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.331484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbk7z\" (UniqueName: \"kubernetes.io/projected/22188524-497c-42cb-85c3-480ae1b6ab00-kube-api-access-wbk7z\") pod \"volume-data-source-validator-78dd696465-zw5mz\" (UID: \"22188524-497c-42cb-85c3-480ae1b6ab00\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" Jun 07 16:30:25.334844 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.334822 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66c94685c9-rwhbx"] Jun 07 16:30:25.398129 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.398074 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:25.423521 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnx7c\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-kube-api-access-vnx7c\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.423581 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6219ca31-7765-4664-ba46-c6bdabedc5f3-config\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.423581 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6219ca31-7765-4664-ba46-c6bdabedc5f3-serving-cert\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.423694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8xsb\" (UniqueName: \"kubernetes.io/projected/a6b264de-e198-4442-b5a3-88b6d3d19e05-kube-api-access-v8xsb\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.423694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6219ca31-7765-4664-ba46-c6bdabedc5f3-trusted-ca\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.423694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6b264de-e198-4442-b5a3-88b6d3d19e05-config\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.423694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.423844 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b264de-e198-4442-b5a3-88b6d3d19e05-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.423844 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-trusted-ca\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.423844 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-image-registry-private-configuration\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.423844 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-certificates\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.423844 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-bound-sa-token\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.424006 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vp4t\" (UniqueName: \"kubernetes.io/projected/6219ca31-7765-4664-ba46-c6bdabedc5f3-kube-api-access-9vp4t\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.424006 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.424006 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.423963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-installation-pull-secrets\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.424131 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.424008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.424131 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.424038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtb5m\" (UniqueName: \"kubernetes.io/projected/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-kube-api-access-dtb5m\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.424131 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.424061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-ca-trust-extracted\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.424131 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.424118 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:25.424313 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.424177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6b264de-e198-4442-b5a3-88b6d3d19e05-config\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.424313 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.424194 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls podName:8bf01b73-58ae-4418-be8b-c3cd0fc595ab nodeName:}" failed. No retries permitted until 2026-06-07 16:30:25.924175136 +0000 UTC m=+195.327523789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-q5nd8" (UID: "8bf01b73-58ae-4418-be8b-c3cd0fc595ab") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:25.424391 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.424326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.425965 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.425948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6b264de-e198-4442-b5a3-88b6d3d19e05-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.431932 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.431909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8xsb\" (UniqueName: \"kubernetes.io/projected/a6b264de-e198-4442-b5a3-88b6d3d19e05-kube-api-access-v8xsb\") pod \"service-ca-operator-6bc5ff68f5-vwbwz\" (UID: \"a6b264de-e198-4442-b5a3-88b6d3d19e05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.433101 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.433078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtb5m\" (UniqueName: \"kubernetes.io/projected/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-kube-api-access-dtb5m\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.433163 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.433151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" Jun 07 16:30:25.482754 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.482723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:25.525066 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6219ca31-7765-4664-ba46-c6bdabedc5f3-trusted-ca\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.525192 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-trusted-ca\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525192 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-image-registry-private-configuration\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525301 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-certificates\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525301 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-bound-sa-token\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525301 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vp4t\" (UniqueName: \"kubernetes.io/projected/6219ca31-7765-4664-ba46-c6bdabedc5f3-kube-api-access-9vp4t\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.525594 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525724 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-installation-pull-secrets\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525724 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-ca-trust-extracted\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnx7c\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-kube-api-access-vnx7c\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.525845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525770 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6219ca31-7765-4664-ba46-c6bdabedc5f3-config\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.525845 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.525787 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:30:25.525845 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.525809 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66c94685c9-rwhbx: secret "image-registry-tls" not found Jun 07 16:30:25.526032 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.525871 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls podName:2d914aaf-9c63-4c0f-b6e1-6257f8463e4f nodeName:}" failed. No retries permitted until 2026-06-07 16:30:26.025853633 +0000 UTC m=+195.429202284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls") pod "image-registry-66c94685c9-rwhbx" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f") : secret "image-registry-tls" not found Jun 07 16:30:25.526032 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6219ca31-7765-4664-ba46-c6bdabedc5f3-trusted-ca\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.526032 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-certificates\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.526186 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.525792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6219ca31-7765-4664-ba46-c6bdabedc5f3-serving-cert\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.526186 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.526120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-trusted-ca\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.526288 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.526254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-ca-trust-extracted\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.526691 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.526580 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6219ca31-7765-4664-ba46-c6bdabedc5f3-config\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.527426 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.527409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" Jun 07 16:30:25.527709 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.527692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-image-registry-private-configuration\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.528135 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.528121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6219ca31-7765-4664-ba46-c6bdabedc5f3-serving-cert\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.528589 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.528571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-installation-pull-secrets\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.534291 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.534273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnx7c\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-kube-api-access-vnx7c\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.534564 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.534546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-bound-sa-token\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:25.535286 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.535269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vp4t\" (UniqueName: \"kubernetes.io/projected/6219ca31-7765-4664-ba46-c6bdabedc5f3-kube-api-access-9vp4t\") pod \"console-operator-668fdbf85c-xn4mm\" (UID: \"6219ca31-7765-4664-ba46-c6bdabedc5f3\") " pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.549763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.549737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:25.549872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.549848 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz"] Jun 07 16:30:25.552365 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:25.552341 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22188524_497c_42cb_85c3_480ae1b6ab00.slice/crio-46eff262cf091ce504283ae0a1c7fa5469ec3db4d65424d8e3156a9daa0af66d WatchSource:0}: Error finding container 46eff262cf091ce504283ae0a1c7fa5469ec3db4d65424d8e3156a9daa0af66d: Status 404 returned error can't find the container with id 46eff262cf091ce504283ae0a1c7fa5469ec3db4d65424d8e3156a9daa0af66d Jun 07 16:30:25.653123 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.653062 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz"] Jun 07 16:30:25.655981 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:25.655943 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b264de_e198_4442_b5a3_88b6d3d19e05.slice/crio-edb5467d1c679a8185a4a68f2e66fe605bd0217d6e22e2bb006b7d2786e52c28 WatchSource:0}: Error finding container edb5467d1c679a8185a4a68f2e66fe605bd0217d6e22e2bb006b7d2786e52c28: Status 404 returned error can't find the container with id edb5467d1c679a8185a4a68f2e66fe605bd0217d6e22e2bb006b7d2786e52c28 Jun 07 16:30:25.678983 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.678965 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-xn4mm"] Jun 07 16:30:25.681037 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:25.681012 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6219ca31_7765_4664_ba46_c6bdabedc5f3.slice/crio-f94fe4938b616626e550be936795b295d2f46e6482bc07ef1c610de1bc76d495 WatchSource:0}: Error finding container f94fe4938b616626e550be936795b295d2f46e6482bc07ef1c610de1bc76d495: Status 404 returned error can't find the container with id f94fe4938b616626e550be936795b295d2f46e6482bc07ef1c610de1bc76d495 Jun 07 16:30:25.929912 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:25.929855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:25.930004 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.929948 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:25.930004 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:25.929996 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls podName:8bf01b73-58ae-4418-be8b-c3cd0fc595ab nodeName:}" failed. No retries permitted until 2026-06-07 16:30:26.929983929 +0000 UTC m=+196.333332579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-q5nd8" (UID: "8bf01b73-58ae-4418-be8b-c3cd0fc595ab") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:26.030544 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:26.030513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:26.030682 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:26.030671 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:30:26.030745 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:26.030685 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66c94685c9-rwhbx: secret "image-registry-tls" not found Jun 07 16:30:26.030745 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:26.030735 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls podName:2d914aaf-9c63-4c0f-b6e1-6257f8463e4f nodeName:}" failed. No retries permitted until 2026-06-07 16:30:27.030719435 +0000 UTC m=+196.434068084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls") pod "image-registry-66c94685c9-rwhbx" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f") : secret "image-registry-tls" not found Jun 07 16:30:26.539650 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:26.539563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" event={"ID":"6219ca31-7765-4664-ba46-c6bdabedc5f3","Type":"ContainerStarted","Data":"f94fe4938b616626e550be936795b295d2f46e6482bc07ef1c610de1bc76d495"} Jun 07 16:30:26.540981 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:26.540918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" event={"ID":"a6b264de-e198-4442-b5a3-88b6d3d19e05","Type":"ContainerStarted","Data":"edb5467d1c679a8185a4a68f2e66fe605bd0217d6e22e2bb006b7d2786e52c28"} Jun 07 16:30:26.542973 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:26.542939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" event={"ID":"22188524-497c-42cb-85c3-480ae1b6ab00","Type":"ContainerStarted","Data":"46eff262cf091ce504283ae0a1c7fa5469ec3db4d65424d8e3156a9daa0af66d"} Jun 07 16:30:26.938595 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:26.938540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:26.938784 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:26.938714 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:26.938784 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:26.938781 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls podName:8bf01b73-58ae-4418-be8b-c3cd0fc595ab nodeName:}" failed. No retries permitted until 2026-06-07 16:30:28.938764495 +0000 UTC m=+198.342113147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-q5nd8" (UID: "8bf01b73-58ae-4418-be8b-c3cd0fc595ab") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:27.039007 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:27.038968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:27.039179 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:27.039117 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:30:27.039179 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:27.039136 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66c94685c9-rwhbx: secret "image-registry-tls" not found Jun 07 16:30:27.039287 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:27.039201 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls podName:2d914aaf-9c63-4c0f-b6e1-6257f8463e4f nodeName:}" failed. No retries permitted until 2026-06-07 16:30:29.039181994 +0000 UTC m=+198.442530664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls") pod "image-registry-66c94685c9-rwhbx" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f") : secret "image-registry-tls" not found Jun 07 16:30:27.547010 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:27.546970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" event={"ID":"22188524-497c-42cb-85c3-480ae1b6ab00","Type":"ContainerStarted","Data":"80c041c53111e1b2e6261f09724a33b54a10c4c4f133f57801fddf52b67d66e1"} Jun 07 16:30:27.562878 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:27.562824 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zw5mz" podStartSLOduration=1.3758179720000001 podStartE2EDuration="2.562808014s" totalImagesPullingTime="1.186990042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:27.56137769 +0000 UTC m=+196.964726372" watchObservedRunningTime="2026-06-07 16:30:27.562808014 +0000 UTC m=+196.966156684" Jun 07 16:30:27.632983 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:27.632944 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:27.684499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:27.684462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:28.551797 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.551770 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/0.log" Jun 07 16:30:28.552259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.551814 2561 generic.go:356] "Generic (PLEG): container finished" podID="6219ca31-7765-4664-ba46-c6bdabedc5f3" containerID="dc6a49e3932b535950b87b89c1909880f6400711932603668a837532aaa54118" exitCode=255 Jun 07 16:30:28.552259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.551905 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" event={"ID":"6219ca31-7765-4664-ba46-c6bdabedc5f3","Type":"ContainerDied","Data":"dc6a49e3932b535950b87b89c1909880f6400711932603668a837532aaa54118"} Jun 07 16:30:28.552259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.552113 2561 scope.go:117] "RemoveContainer" containerID="dc6a49e3932b535950b87b89c1909880f6400711932603668a837532aaa54118" Jun 07 16:30:28.553448 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.553424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" event={"ID":"a6b264de-e198-4442-b5a3-88b6d3d19e05","Type":"ContainerStarted","Data":"ece29c50253006c8bcf909ecee21d3b0115f2a2d80dde120aef5038c7aab7468"} Jun 07 16:30:28.581342 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.581290 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" podStartSLOduration=1.276511496 podStartE2EDuration="3.581273699s" totalImagesPullingTime="2.304762203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:28.58042272 +0000 UTC m=+197.983771584" watchObservedRunningTime="2026-06-07 16:30:28.581273699 +0000 UTC m=+197.984622372" Jun 07 16:30:28.954886 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:28.954789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:28.955037 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:28.954912 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:28.955037 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:28.954966 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls podName:8bf01b73-58ae-4418-be8b-c3cd0fc595ab nodeName:}" failed. No retries permitted until 2026-06-07 16:30:32.954952549 +0000 UTC m=+202.358301198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-q5nd8" (UID: "8bf01b73-58ae-4418-be8b-c3cd0fc595ab") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:29.055338 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.055303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:29.055497 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:29.055479 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:30:29.055551 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:29.055503 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66c94685c9-rwhbx: secret "image-registry-tls" not found Jun 07 16:30:29.055627 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:29.055561 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls podName:2d914aaf-9c63-4c0f-b6e1-6257f8463e4f nodeName:}" failed. No retries permitted until 2026-06-07 16:30:33.055542309 +0000 UTC m=+202.458890965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls") pod "image-registry-66c94685c9-rwhbx" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f") : secret "image-registry-tls" not found Jun 07 16:30:29.057686 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.057663 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9"] Jun 07 16:30:29.058190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.058170 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:29.060617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.060603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" Jun 07 16:30:29.063129 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.063110 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 07 16:30:29.063205 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.063127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pd8fz\"" Jun 07 16:30:29.063408 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.063395 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 07 16:30:29.069533 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.069510 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9"] Jun 07 16:30:29.132626 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.132587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:29.156386 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.156354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26fd\" (UniqueName: \"kubernetes.io/projected/f15d6965-b040-4ae8-8f15-616d7a0d12ec-kube-api-access-x26fd\") pod \"migrator-955ffdf5f-szqj9\" (UID: \"f15d6965-b040-4ae8-8f15-616d7a0d12ec\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" Jun 07 16:30:29.194651 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.194600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:29.256890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.256858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26fd\" (UniqueName: \"kubernetes.io/projected/f15d6965-b040-4ae8-8f15-616d7a0d12ec-kube-api-access-x26fd\") pod \"migrator-955ffdf5f-szqj9\" (UID: \"f15d6965-b040-4ae8-8f15-616d7a0d12ec\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" Jun 07 16:30:29.264547 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.264529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26fd\" (UniqueName: \"kubernetes.io/projected/f15d6965-b040-4ae8-8f15-616d7a0d12ec-kube-api-access-x26fd\") pod \"migrator-955ffdf5f-szqj9\" (UID: \"f15d6965-b040-4ae8-8f15-616d7a0d12ec\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" Jun 07 16:30:29.368854 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.368820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" Jun 07 16:30:29.488311 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.488276 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9"] Jun 07 16:30:29.491287 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.491259 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:29.493573 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:29.493545 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15d6965_b040_4ae8_8f15_616d7a0d12ec.slice/crio-c5ce264689357ac2bc3bc538e17225ea39bb5efacdbc3dac229d1201afedd1f9 WatchSource:0}: Error finding container c5ce264689357ac2bc3bc538e17225ea39bb5efacdbc3dac229d1201afedd1f9: Status 404 returned error can't find the container with id c5ce264689357ac2bc3bc538e17225ea39bb5efacdbc3dac229d1201afedd1f9 Jun 07 16:30:29.558209 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.558142 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:30:29.558606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.558497 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/0.log" Jun 07 16:30:29.558606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.558530 2561 generic.go:356] "Generic (PLEG): container finished" podID="6219ca31-7765-4664-ba46-c6bdabedc5f3" containerID="d307ff5287c71466319970a9518e543433e4931d32bea42be470192173d40fc3" exitCode=255 Jun 07 16:30:29.558606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.558591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" event={"ID":"6219ca31-7765-4664-ba46-c6bdabedc5f3","Type":"ContainerDied","Data":"d307ff5287c71466319970a9518e543433e4931d32bea42be470192173d40fc3"} Jun 07 16:30:29.559375 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.559357 2561 scope.go:117] "RemoveContainer" containerID="dc6a49e3932b535950b87b89c1909880f6400711932603668a837532aaa54118" Jun 07 16:30:29.559462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.559447 2561 scope.go:117] "RemoveContainer" containerID="d307ff5287c71466319970a9518e543433e4931d32bea42be470192173d40fc3" Jun 07 16:30:29.559651 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:29.559607 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-xn4mm_openshift-console-operator(6219ca31-7765-4664-ba46-c6bdabedc5f3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" podUID="6219ca31-7765-4664-ba46-c6bdabedc5f3" Jun 07 16:30:29.559826 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.559804 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" event={"ID":"f15d6965-b040-4ae8-8f15-616d7a0d12ec","Type":"ContainerStarted","Data":"c5ce264689357ac2bc3bc538e17225ea39bb5efacdbc3dac229d1201afedd1f9"} Jun 07 16:30:29.577487 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.577465 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:29.629402 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.629380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:29.865162 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:29.865076 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:30.336758 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.336716 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:30.437357 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.437332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:30.564931 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.564903 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:30:30.565363 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.565237 2561 scope.go:117] "RemoveContainer" containerID="d307ff5287c71466319970a9518e543433e4931d32bea42be470192173d40fc3" Jun 07 16:30:30.565421 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:30.565386 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-xn4mm_openshift-console-operator(6219ca31-7765-4664-ba46-c6bdabedc5f3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" podUID="6219ca31-7765-4664-ba46-c6bdabedc5f3" Jun 07 16:30:30.566600 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.566572 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" event={"ID":"f15d6965-b040-4ae8-8f15-616d7a0d12ec","Type":"ContainerStarted","Data":"9674ce4bb17f0d930bf27b7ad98db97fb60ec40f8f8701632a55b93ae5b01284"} Jun 07 16:30:30.566729 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.566610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" event={"ID":"f15d6965-b040-4ae8-8f15-616d7a0d12ec","Type":"ContainerStarted","Data":"a1d7c080cef865962221f6cfb92753a546d11934411f977bbcc493ff196116a5"} Jun 07 16:30:30.595687 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.595582 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szqj9" podStartSLOduration=0.731178532 podStartE2EDuration="1.595568191s" totalImagesPullingTime="864.389659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:30.595070635 +0000 UTC m=+199.998419307" watchObservedRunningTime="2026-06-07 16:30:30.595568191 +0000 UTC m=+199.998916862" Jun 07 16:30:30.669428 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.669398 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:30.771369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:30.771345 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:31.975275 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:31.975244 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:32.018293 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:32.018273 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjhsn_42d5ecfd-006a-4b61-accc-df6012082fe4/dns-node-resolver/0.log" Jun 07 16:30:32.076837 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:32.076813 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:32.816142 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:32.816111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:32.983615 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:32.983582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:32.983961 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:32.983730 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:32.983961 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:32.983803 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls podName:8bf01b73-58ae-4418-be8b-c3cd0fc595ab nodeName:}" failed. No retries permitted until 2026-06-07 16:30:40.983788383 +0000 UTC m=+210.387137033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-q5nd8" (UID: "8bf01b73-58ae-4418-be8b-c3cd0fc595ab") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:33.083947 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:33.083877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:33.084066 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:33.084011 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:30:33.084066 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:33.084029 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66c94685c9-rwhbx: secret "image-registry-tls" not found Jun 07 16:30:33.084133 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:33.084087 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls podName:2d914aaf-9c63-4c0f-b6e1-6257f8463e4f nodeName:}" failed. No retries permitted until 2026-06-07 16:30:41.084073082 +0000 UTC m=+210.487421732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls") pod "image-registry-66c94685c9-rwhbx" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f") : secret "image-registry-tls" not found Jun 07 16:30:33.420333 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:33.420263 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf7mk_75deb2a9-94d0-47db-8a2b-2573142d1793/node-ca/0.log" Jun 07 16:30:33.819718 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:33.819692 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b52tw_17513ad6-d53b-4329-92db-436f2f32d90d/serve-healthcheck-canary/0.log" Jun 07 16:30:34.419942 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:34.419917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-szqj9_f15d6965-b040-4ae8-8f15-616d7a0d12ec/migrator/0.log" Jun 07 16:30:34.619748 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:34.619720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-szqj9_f15d6965-b040-4ae8-8f15-616d7a0d12ec/graceful-termination/0.log" Jun 07 16:30:35.205458 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.205426 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:35.307304 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.307274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:35.461010 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.460940 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:35.549969 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.549938 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:35.550114 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.549990 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:35.550304 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.550291 2561 scope.go:117] "RemoveContainer" containerID="d307ff5287c71466319970a9518e543433e4931d32bea42be470192173d40fc3" Jun 07 16:30:35.550449 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:35.550432 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-xn4mm_openshift-console-operator(6219ca31-7765-4664-ba46-c6bdabedc5f3)\"" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" podUID="6219ca31-7765-4664-ba46-c6bdabedc5f3" Jun 07 16:30:35.558584 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.558561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:35.659527 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.659500 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:35.777227 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.777198 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:35.967809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:35.967778 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:36.762340 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:36.762311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:37.364309 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:37.364277 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:37.574567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:37.574538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:37.768092 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:37.768062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:38.167245 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:38.167168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:38.268348 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:38.268314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:38.967650 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:38.967599 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:39.162130 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:39.162102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:39.214942 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:39.214913 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:39.505346 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:39.505309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:39.567544 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:39.567508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:39.765283 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:39.765202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:39.866268 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:39.866237 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:40.165710 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:40.165617 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:40.565426 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:40.565399 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:41.045424 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.045397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:41.045600 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:41.045528 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:41.045600 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:30:41.045582 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls podName:8bf01b73-58ae-4418-be8b-c3cd0fc595ab nodeName:}" failed. No retries permitted until 2026-06-07 16:30:57.045567469 +0000 UTC m=+226.448916118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-q5nd8" (UID: "8bf01b73-58ae-4418-be8b-c3cd0fc595ab") : secret "cluster-monitoring-operator-tls" not found Jun 07 16:30:41.146144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.146105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:41.148445 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.148426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"image-registry-66c94685c9-rwhbx\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:41.191084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.191060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:41.230123 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.230104 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:41.347566 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.347543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66c94685c9-rwhbx"] Jun 07 16:30:41.350107 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:41.350084 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d914aaf_9c63_4c0f_b6e1_6257f8463e4f.slice/crio-f0cdcc22ddf39caaed9d6a941d7d33b505895fd13715673c9cc1a5095adea13e WatchSource:0}: Error finding container f0cdcc22ddf39caaed9d6a941d7d33b505895fd13715673c9cc1a5095adea13e: Status 404 returned error can't find the container with id f0cdcc22ddf39caaed9d6a941d7d33b505895fd13715673c9cc1a5095adea13e Jun 07 16:30:41.568403 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.568320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:41.601010 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.600976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" event={"ID":"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f","Type":"ContainerStarted","Data":"6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc"} Jun 07 16:30:41.601150 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.601035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" event={"ID":"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f","Type":"ContainerStarted","Data":"f0cdcc22ddf39caaed9d6a941d7d33b505895fd13715673c9cc1a5095adea13e"} Jun 07 16:30:41.601150 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.601071 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:30:41.618054 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.617843 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" podStartSLOduration=16.617825569 podStartE2EDuration="16.617825569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:41.616750648 +0000 UTC m=+211.020099319" watchObservedRunningTime="2026-06-07 16:30:41.617825569 +0000 UTC m=+211.021174240" Jun 07 16:30:41.960649 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:41.960552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:42.058897 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:42.058864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:42.164725 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:42.164696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:42.365963 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:42.365935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:42.772101 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:42.772071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:43.166027 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:43.165946 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:43.377586 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:43.377557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:43.767296 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:43.767260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:44.561495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:44.561462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:44.969924 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:44.969842 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:45.166508 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:45.166481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:45.361957 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:45.361921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:45.566422 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:45.566387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:45.967151 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:45.967118 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:50.114248 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:50.114218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:50.990580 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:50.990551 2561 scope.go:117] "RemoveContainer" containerID="d307ff5287c71466319970a9518e543433e4931d32bea42be470192173d40fc3" Jun 07 16:30:51.586571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.586537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:51.633320 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.633294 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:30:51.633451 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.633420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" event={"ID":"6219ca31-7765-4664-ba46-c6bdabedc5f3","Type":"ContainerStarted","Data":"6d40576f292325fe24d49ef2de217761d2cb8f248a7e000fdab999bceac0444d"} Jun 07 16:30:51.633874 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.633850 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:51.638747 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.638726 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" Jun 07 16:30:51.648816 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.648756 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-xn4mm" podStartSLOduration=24.366877636 podStartE2EDuration="26.648744398s" totalImagesPullingTime="2.281866762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:51.647767006 +0000 UTC m=+221.051115687" watchObservedRunningTime="2026-06-07 16:30:51.648744398 +0000 UTC m=+221.052093068" Jun 07 16:30:51.652575 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.652557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:51.707214 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.707189 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:51.884810 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:51.884735 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:52.073949 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:52.073916 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:52.260920 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:52.260887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:52.310576 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:52.310547 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:52.664873 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:52.664794 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:52.718649 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:52.718604 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:53.060022 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.059994 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:53.110908 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.110887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:53.512088 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.512059 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:53.512741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.512718 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66c94685c9-rwhbx"] Jun 07 16:30:53.529815 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.529790 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vvx7r"] Jun 07 16:30:53.532337 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.532318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.536133 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.536113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4dd7s\"" Jun 07 16:30:53.536773 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.536754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 16:30:53.537260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.537245 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 16:30:53.537427 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.537413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 16:30:53.538237 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.538222 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 16:30:53.546790 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.546769 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvx7r"] Jun 07 16:30:53.623886 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.623856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:53.635472 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.635445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/715117a2-affb-4283-9060-15807dfff757-data-volume\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.635578 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.635475 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/715117a2-affb-4283-9060-15807dfff757-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.635578 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.635520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/715117a2-affb-4283-9060-15807dfff757-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.635683 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.635574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs45j\" (UniqueName: \"kubernetes.io/projected/715117a2-affb-4283-9060-15807dfff757-kube-api-access-qs45j\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.635683 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.635598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/715117a2-affb-4283-9060-15807dfff757-crio-socket\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.723624 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.723591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:53.736597 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/715117a2-affb-4283-9060-15807dfff757-crio-socket\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.736732 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/715117a2-affb-4283-9060-15807dfff757-data-volume\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.736732 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736696 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/715117a2-affb-4283-9060-15807dfff757-crio-socket\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.736732 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/715117a2-affb-4283-9060-15807dfff757-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.736884 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/715117a2-affb-4283-9060-15807dfff757-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.736884 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs45j\" (UniqueName: \"kubernetes.io/projected/715117a2-affb-4283-9060-15807dfff757-kube-api-access-qs45j\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.737018 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.736996 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/715117a2-affb-4283-9060-15807dfff757-data-volume\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.737300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.737278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/715117a2-affb-4283-9060-15807dfff757-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.739275 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.739255 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/715117a2-affb-4283-9060-15807dfff757-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.744219 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.744198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs45j\" (UniqueName: \"kubernetes.io/projected/715117a2-affb-4283-9060-15807dfff757-kube-api-access-qs45j\") pod \"insights-runtime-extractor-vvx7r\" (UID: \"715117a2-affb-4283-9060-15807dfff757\") " pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.842227 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.842151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvx7r" Jun 07 16:30:53.963694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:53.963662 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvx7r"] Jun 07 16:30:53.966219 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:53.966199 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715117a2_affb_4283_9060_15807dfff757.slice/crio-499d76fbcd9f2f138223bbea45342437ee0c6ebb57f6383664db76b5abed44fd WatchSource:0}: Error finding container 499d76fbcd9f2f138223bbea45342437ee0c6ebb57f6383664db76b5abed44fd: Status 404 returned error can't find the container with id 499d76fbcd9f2f138223bbea45342437ee0c6ebb57f6383664db76b5abed44fd Jun 07 16:30:54.091805 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:54.091776 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:54.145435 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:54.145356 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:54.645256 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:54.645225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvx7r" event={"ID":"715117a2-affb-4283-9060-15807dfff757","Type":"ContainerStarted","Data":"ed6f115a78b33389f0c5503aa8538ca80870808c648ac6f525cb2ae690d95f06"} Jun 07 16:30:54.645385 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:54.645321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvx7r" event={"ID":"715117a2-affb-4283-9060-15807dfff757","Type":"ContainerStarted","Data":"ab67839628b446cdb64c0e980da3e8ea4222c5023914e9fdf5a02dcd70ee2cd1"} Jun 07 16:30:54.645385 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:54.645353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvx7r" event={"ID":"715117a2-affb-4283-9060-15807dfff757","Type":"ContainerStarted","Data":"499d76fbcd9f2f138223bbea45342437ee0c6ebb57f6383664db76b5abed44fd"} Jun 07 16:30:56.045916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:56.045881 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:56.096269 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:56.096230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:56.654399 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:56.654318 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvx7r" event={"ID":"715117a2-affb-4283-9060-15807dfff757","Type":"ContainerStarted","Data":"9e4e5d5c27ad5d00005a240d6b2702eab702fc2ea5749ef105274521e3c69dd7"} Jun 07 16:30:56.671034 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:56.670982 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vvx7r" podStartSLOduration=1.5057032110000002 podStartE2EDuration="3.670970444s" totalImagesPullingTime="2.165267233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:30:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:56.669431925 +0000 UTC m=+226.072780596" watchObservedRunningTime="2026-06-07 16:30:56.670970444 +0000 UTC m=+226.074319114" Jun 07 16:30:57.061450 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:57.061421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:57.063835 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:57.063814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf01b73-58ae-4418-be8b-c3cd0fc595ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-q5nd8\" (UID: \"8bf01b73-58ae-4418-be8b-c3cd0fc595ab\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:57.344581 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:57.344515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" Jun 07 16:30:57.461176 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:57.461149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8"] Jun 07 16:30:57.464787 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:30:57.464763 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf01b73_58ae_4418_be8b_c3cd0fc595ab.slice/crio-bd21cd91fa096d903adf7ff87b369733ac497e88377a27a9e2c7c265552a6964 WatchSource:0}: Error finding container bd21cd91fa096d903adf7ff87b369733ac497e88377a27a9e2c7c265552a6964: Status 404 returned error can't find the container with id bd21cd91fa096d903adf7ff87b369733ac497e88377a27a9e2c7c265552a6964 Jun 07 16:30:57.658689 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:57.658595 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" event={"ID":"8bf01b73-58ae-4418-be8b-c3cd0fc595ab","Type":"ContainerStarted","Data":"bd21cd91fa096d903adf7ff87b369733ac497e88377a27a9e2c7c265552a6964"} Jun 07 16:30:59.435508 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:59.435441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:59.508026 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:59.507984 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:30:59.940279 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:30:59.940249 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:00.041247 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.041208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:00.100436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.100407 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:00.101801 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.101775 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js"] Jun 07 16:31:00.104769 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.104755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:00.106916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.106893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 07 16:31:00.107022 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.106939 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7wmxd\"" Jun 07 16:31:00.112078 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.112057 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js"] Jun 07 16:31:00.183860 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.183837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-c84js\" (UID: \"56f2293d-bd50-4152-9f3b-a9010599a439\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:00.284734 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.284706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-c84js\" (UID: \"56f2293d-bd50-4152-9f3b-a9010599a439\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:00.284838 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:00.284811 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 07 16:31:00.284888 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:00.284862 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates podName:56f2293d-bd50-4152-9f3b-a9010599a439 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:00.784847683 +0000 UTC m=+230.188196332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-c84js" (UID: "56f2293d-bd50-4152-9f3b-a9010599a439") : secret "prometheus-operator-admission-webhook-tls" not found Jun 07 16:31:00.669338 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.669243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" event={"ID":"8bf01b73-58ae-4418-be8b-c3cd0fc595ab","Type":"ContainerStarted","Data":"d91615214829cf9a786b82a48f2d09e4aec1891fb1cb958f822643613827b650"} Jun 07 16:31:00.685204 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.685161 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-q5nd8" podStartSLOduration=33.540976108 podStartE2EDuration="35.685146209s" totalImagesPullingTime="2.144170101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:00.683967817 +0000 UTC m=+230.087316500" watchObservedRunningTime="2026-06-07 16:31:00.685146209 +0000 UTC m=+230.088494880" Jun 07 16:31:00.787197 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:00.787164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-c84js\" (UID: \"56f2293d-bd50-4152-9f3b-a9010599a439\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:00.787325 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:00.787273 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 07 16:31:00.787386 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:00.787332 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates podName:56f2293d-bd50-4152-9f3b-a9010599a439 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:01.787315491 +0000 UTC m=+231.190664156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-c84js" (UID: "56f2293d-bd50-4152-9f3b-a9010599a439") : secret "prometheus-operator-admission-webhook-tls" not found Jun 07 16:31:01.004442 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:01.004387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:01.104438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:01.104405 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:01.204313 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:01.204282 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:01.792869 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:01.792838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-c84js\" (UID: \"56f2293d-bd50-4152-9f3b-a9010599a439\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:01.795220 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:01.795198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/56f2293d-bd50-4152-9f3b-a9010599a439-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-c84js\" (UID: \"56f2293d-bd50-4152-9f3b-a9010599a439\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:01.914690 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:01.914663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:02.051927 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:02.051841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js"] Jun 07 16:31:02.054348 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:02.054322 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f2293d_bd50_4152_9f3b_a9010599a439.slice/crio-816d230e944f15957efb87123a8dbeaf070193884d8803cf32a36050ecea0e70 WatchSource:0}: Error finding container 816d230e944f15957efb87123a8dbeaf070193884d8803cf32a36050ecea0e70: Status 404 returned error can't find the container with id 816d230e944f15957efb87123a8dbeaf070193884d8803cf32a36050ecea0e70 Jun 07 16:31:02.676806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:02.676770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" event={"ID":"56f2293d-bd50-4152-9f3b-a9010599a439","Type":"ContainerStarted","Data":"816d230e944f15957efb87123a8dbeaf070193884d8803cf32a36050ecea0e70"} Jun 07 16:31:03.294826 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.294798 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:03.348152 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.348132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:03.517704 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.517680 2561 patch_prober.go:28] interesting pod/image-registry-66c94685c9-rwhbx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:03.517802 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.517732 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:03.681621 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.681592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" event={"ID":"56f2293d-bd50-4152-9f3b-a9010599a439","Type":"ContainerStarted","Data":"75245ee011023ae53551345e10de8affbca3129ff5553f65203569ac09694aa8"} Jun 07 16:31:03.681808 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.681791 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:03.686063 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.686045 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" Jun 07 16:31:03.695757 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:03.695715 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-c84js" podStartSLOduration=2.609061804 podStartE2EDuration="3.695702738s" totalImagesPullingTime="1.086640934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:03.695688546 +0000 UTC m=+233.099037226" watchObservedRunningTime="2026-06-07 16:31:03.695702738 +0000 UTC m=+233.099051403" Jun 07 16:31:04.126732 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.126702 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:04.159893 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.159867 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-m57sv"] Jun 07 16:31:04.162878 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.162861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.165015 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.164994 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 07 16:31:04.166268 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.166253 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jcrfz\"" Jun 07 16:31:04.166329 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.166265 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 07 16:31:04.166329 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.166310 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 16:31:04.171457 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.171439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-m57sv"] Jun 07 16:31:04.192822 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.192801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:04.209916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.209896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.209978 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.209934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d968de-cf4d-49fb-b915-c86fa9a171ea-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.209978 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.209952 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.210040 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.210016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4klr\" (UniqueName: \"kubernetes.io/projected/88d968de-cf4d-49fb-b915-c86fa9a171ea-kube-api-access-c4klr\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.310231 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.310203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d968de-cf4d-49fb-b915-c86fa9a171ea-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.310517 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.310238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.310517 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.310270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4klr\" (UniqueName: \"kubernetes.io/projected/88d968de-cf4d-49fb-b915-c86fa9a171ea-kube-api-access-c4klr\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.310517 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.310317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.310517 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:04.310364 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 07 16:31:04.310517 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:04.310433 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-tls podName:88d968de-cf4d-49fb-b915-c86fa9a171ea nodeName:}" failed. No retries permitted until 2026-06-07 16:31:04.810416068 +0000 UTC m=+234.213764718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-m57sv" (UID: "88d968de-cf4d-49fb-b915-c86fa9a171ea") : secret "prometheus-operator-tls" not found Jun 07 16:31:04.310858 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.310830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d968de-cf4d-49fb-b915-c86fa9a171ea-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.312755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.312734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.319073 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.319051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4klr\" (UniqueName: \"kubernetes.io/projected/88d968de-cf4d-49fb-b915-c86fa9a171ea-kube-api-access-c4klr\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.569711 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.569686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:04.814738 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.814712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:04.816960 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:04.816935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d968de-cf4d-49fb-b915-c86fa9a171ea-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-m57sv\" (UID: \"88d968de-cf4d-49fb-b915-c86fa9a171ea\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:05.071962 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:05.071937 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" Jun 07 16:31:05.195053 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:05.195028 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-m57sv"] Jun 07 16:31:05.197621 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:05.197596 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d968de_cf4d_49fb_b915_c86fa9a171ea.slice/crio-33804140841d21adb3574eaa21d053a3ee9d0471c446f58cf68dcb85cf5971eb WatchSource:0}: Error finding container 33804140841d21adb3574eaa21d053a3ee9d0471c446f58cf68dcb85cf5971eb: Status 404 returned error can't find the container with id 33804140841d21adb3574eaa21d053a3ee9d0471c446f58cf68dcb85cf5971eb Jun 07 16:31:05.688690 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:05.688651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" event={"ID":"88d968de-cf4d-49fb-b915-c86fa9a171ea","Type":"ContainerStarted","Data":"33804140841d21adb3574eaa21d053a3ee9d0471c446f58cf68dcb85cf5971eb"} Jun 07 16:31:06.677154 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:06.677065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:06.693135 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:06.693110 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" event={"ID":"88d968de-cf4d-49fb-b915-c86fa9a171ea","Type":"ContainerStarted","Data":"20fec97c74b3315f14d0d70524d55ae8828c8823a204ceb08c2eefb9736c66da"} Jun 07 16:31:06.693546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:06.693163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" event={"ID":"88d968de-cf4d-49fb-b915-c86fa9a171ea","Type":"ContainerStarted","Data":"efddb399b3971e309fe1f7e0e2ada4add7789b9b441f2c3d609059425a152fd9"} Jun 07 16:31:06.710915 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:06.710869 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-m57sv" podStartSLOduration=1.499345796 podStartE2EDuration="2.710854239s" totalImagesPullingTime="1.211508443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:06.709191391 +0000 UTC m=+236.112540064" watchObservedRunningTime="2026-06-07 16:31:06.710854239 +0000 UTC m=+236.114203245" Jun 07 16:31:07.492520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:07.492490 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:07.593651 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:07.593605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.244703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.244677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.457566 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.457527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.479687 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.479657 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn"] Jun 07 16:31:08.482786 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.482769 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.485203 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.485180 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 07 16:31:08.485298 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.485215 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 07 16:31:08.485298 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.485215 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p4lcx\"" Jun 07 16:31:08.491536 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.491510 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn"] Jun 07 16:31:08.498961 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.498915 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f"] Jun 07 16:31:08.501904 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.501890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.504233 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.504216 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 07 16:31:08.504523 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.504504 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zxbvc\"" Jun 07 16:31:08.504606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.504507 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 07 16:31:08.504606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.504566 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 07 16:31:08.512489 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.512468 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r6sjh"] Jun 07 16:31:08.515419 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.515400 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f"] Jun 07 16:31:08.515522 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.515509 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.518058 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.518033 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 16:31:08.518058 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.518053 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 16:31:08.518207 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.518058 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 16:31:08.518207 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.518107 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wsm7l\"" Jun 07 16:31:08.532908 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.532886 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.547250 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.547338 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.547338 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dbceb28-b110-4972-9b4b-4330770c9b6d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.547421 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdd26\" (UniqueName: \"kubernetes.io/projected/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-api-access-wdd26\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.547421 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dbceb28-b110-4972-9b4b-4330770c9b6d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.547421 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dbceb28-b110-4972-9b4b-4330770c9b6d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.547567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.547567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxrn\" (UniqueName: \"kubernetes.io/projected/1dbceb28-b110-4972-9b4b-4330770c9b6d-kube-api-access-2jxrn\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.547567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.547567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.547540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.624581 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.624550 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.648343 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-wtmp\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648447 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-tls\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648447 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-root\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648447 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.648568 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-sys\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648568 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v295w\" (UniqueName: \"kubernetes.io/projected/b68e96f5-8178-47e8-a37a-522d103dd16b-kube-api-access-v295w\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648671 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.648671 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dbceb28-b110-4972-9b4b-4330770c9b6d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.648671 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-textfile\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648810 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdd26\" (UniqueName: \"kubernetes.io/projected/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-api-access-wdd26\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.648810 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.648810 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.648956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648829 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dbceb28-b110-4972-9b4b-4330770c9b6d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.648956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dbceb28-b110-4972-9b4b-4330770c9b6d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.648956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.648956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxrn\" (UniqueName: \"kubernetes.io/projected/1dbceb28-b110-4972-9b4b-4330770c9b6d-kube-api-access-2jxrn\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.648956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.649180 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.649180 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.648999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b68e96f5-8178-47e8-a37a-522d103dd16b-metrics-client-ca\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.649180 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.649027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.649180 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:08.649076 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 07 16:31:08.649180 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:08.649129 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-tls podName:c9231e5a-a75f-4edf-a1ea-277811ae4ba5 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:09.149112021 +0000 UTC m=+238.552460670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-6nh8f" (UID: "c9231e5a-a75f-4edf-a1ea-277811ae4ba5") : secret "kube-state-metrics-tls" not found Jun 07 16:31:08.649416 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.649347 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.649470 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.649432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dbceb28-b110-4972-9b4b-4330770c9b6d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.649524 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.649503 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.651626 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.651601 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dbceb28-b110-4972-9b4b-4330770c9b6d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.651951 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.651932 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.651995 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.651932 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dbceb28-b110-4972-9b4b-4330770c9b6d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.656663 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.656625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdd26\" (UniqueName: \"kubernetes.io/projected/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-api-access-wdd26\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:08.656917 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.656897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxrn\" (UniqueName: \"kubernetes.io/projected/1dbceb28-b110-4972-9b4b-4330770c9b6d-kube-api-access-2jxrn\") pod \"openshift-state-metrics-65f78d5c66-fz2gn\" (UID: \"1dbceb28-b110-4972-9b4b-4330770c9b6d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.728857 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.728833 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.749920 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.749859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-textfile\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.749920 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.749889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750087 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b68e96f5-8178-47e8-a37a-522d103dd16b-metrics-client-ca\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750087 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750185 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-wtmp\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750185 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-tls\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750288 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-root\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750288 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-sys\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750288 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-textfile\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750288 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v295w\" (UniqueName: \"kubernetes.io/projected/b68e96f5-8178-47e8-a37a-522d103dd16b-kube-api-access-v295w\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750288 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:08.750276 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 16:31:08.750473 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-wtmp\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750473 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:08.750335 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-tls podName:b68e96f5-8178-47e8-a37a-522d103dd16b nodeName:}" failed. No retries permitted until 2026-06-07 16:31:09.250316108 +0000 UTC m=+238.653664779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-tls") pod "node-exporter-r6sjh" (UID: "b68e96f5-8178-47e8-a37a-522d103dd16b") : secret "node-exporter-tls" not found Jun 07 16:31:08.750473 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-root\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750473 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750355 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b68e96f5-8178-47e8-a37a-522d103dd16b-sys\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750648 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.750848 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.750823 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b68e96f5-8178-47e8-a37a-522d103dd16b-metrics-client-ca\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.752203 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.752183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.758152 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.758133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v295w\" (UniqueName: \"kubernetes.io/projected/b68e96f5-8178-47e8-a37a-522d103dd16b-kube-api-access-v295w\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:08.791953 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.791931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" Jun 07 16:31:08.826657 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.826606 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.914946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.914816 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn"] Jun 07 16:31:08.917382 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:08.917357 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbceb28_b110_4972_9b4b_4330770c9b6d.slice/crio-19c75941b8d9a0960219edaecc263c6b73b1f6214bfa23668e037ef015802a6e WatchSource:0}: Error finding container 19c75941b8d9a0960219edaecc263c6b73b1f6214bfa23668e037ef015802a6e: Status 404 returned error can't find the container with id 19c75941b8d9a0960219edaecc263c6b73b1f6214bfa23668e037ef015802a6e Jun 07 16:31:08.918806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.918770 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:08.971073 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:08.971047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.071888 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.071852 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.154216 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.154182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:09.156528 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.156507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9231e5a-a75f-4edf-a1ea-277811ae4ba5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6nh8f\" (UID: \"c9231e5a-a75f-4edf-a1ea-277811ae4ba5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:09.254958 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.254932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-tls\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:09.257306 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.257281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b68e96f5-8178-47e8-a37a-522d103dd16b-node-exporter-tls\") pod \"node-exporter-r6sjh\" (UID: \"b68e96f5-8178-47e8-a37a-522d103dd16b\") " pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:09.291183 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.291102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.389548 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.389513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.410991 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.410966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" Jun 07 16:31:09.425068 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.425049 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r6sjh" Jun 07 16:31:09.438849 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:09.438813 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68e96f5_8178_47e8_a37a_522d103dd16b.slice/crio-c7938f7acc93390e413c960c23a9edf84425b06f4b13fc5a11440cb97e45125c WatchSource:0}: Error finding container c7938f7acc93390e413c960c23a9edf84425b06f4b13fc5a11440cb97e45125c: Status 404 returned error can't find the container with id c7938f7acc93390e413c960c23a9edf84425b06f4b13fc5a11440cb97e45125c Jun 07 16:31:09.490055 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.489997 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.567030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.566953 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f"] Jun 07 16:31:09.571687 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:09.571657 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9231e5a_a75f_4edf_a1ea_277811ae4ba5.slice/crio-c22da7bad2a6f4927206e3fe4bce3c195d6f0d4fa53e0bb5c5759844345fa2c9 WatchSource:0}: Error finding container c22da7bad2a6f4927206e3fe4bce3c195d6f0d4fa53e0bb5c5759844345fa2c9: Status 404 returned error can't find the container with id c22da7bad2a6f4927206e3fe4bce3c195d6f0d4fa53e0bb5c5759844345fa2c9 Jun 07 16:31:09.579513 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.579002 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 16:31:09.584423 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.584383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.585177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.585156 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.589115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589088 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 07 16:31:09.589250 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 07 16:31:09.589349 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589286 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 07 16:31:09.589503 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 07 16:31:09.589503 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589496 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 07 16:31:09.589767 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589747 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 07 16:31:09.589862 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589747 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 07 16:31:09.590003 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.589986 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kmcw6\"" Jun 07 16:31:09.590179 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.590163 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 07 16:31:09.590372 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.590353 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 07 16:31:09.595570 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.595466 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 16:31:09.659520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvft\" (UniqueName: \"kubernetes.io/projected/7ff77358-0143-45d4-bb47-570db4ebf30d-kube-api-access-jcvft\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff77358-0143-45d4-bb47-570db4ebf30d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff77358-0143-45d4-bb47-570db4ebf30d-config-out\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.659890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.659771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-web-config\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.690682 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.690650 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:09.704136 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.704102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6sjh" event={"ID":"b68e96f5-8178-47e8-a37a-522d103dd16b","Type":"ContainerStarted","Data":"c7938f7acc93390e413c960c23a9edf84425b06f4b13fc5a11440cb97e45125c"} Jun 07 16:31:09.705274 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.705245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" event={"ID":"c9231e5a-a75f-4edf-a1ea-277811ae4ba5","Type":"ContainerStarted","Data":"c22da7bad2a6f4927206e3fe4bce3c195d6f0d4fa53e0bb5c5759844345fa2c9"} Jun 07 16:31:09.706917 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.706895 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" event={"ID":"1dbceb28-b110-4972-9b4b-4330770c9b6d","Type":"ContainerStarted","Data":"269678e3779cc42eb9979ab331a47b8218670732ba9cba68d99b8a92dff1ffa6"} Jun 07 16:31:09.706989 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.706936 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" event={"ID":"1dbceb28-b110-4972-9b4b-4330770c9b6d","Type":"ContainerStarted","Data":"a84aea8b99a54a565db0e855a3074c511cd4fea1136ebaeba6564334e5397654"} Jun 07 16:31:09.706989 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.706955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" event={"ID":"1dbceb28-b110-4972-9b4b-4330770c9b6d","Type":"ContainerStarted","Data":"19c75941b8d9a0960219edaecc263c6b73b1f6214bfa23668e037ef015802a6e"} Jun 07 16:31:09.761096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-web-config\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvft\" (UniqueName: \"kubernetes.io/projected/7ff77358-0143-45d4-bb47-570db4ebf30d-kube-api-access-jcvft\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761356 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761356 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761356 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761310 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761356 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff77358-0143-45d4-bb47-570db4ebf30d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff77358-0143-45d4-bb47-570db4ebf30d-config-out\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.761496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.761858 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:09.761824 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-trusted-ca-bundle podName:7ff77358-0143-45d4-bb47-570db4ebf30d nodeName:}" failed. No retries permitted until 2026-06-07 16:31:10.261802182 +0000 UTC m=+239.665150850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7ff77358-0143-45d4-bb47-570db4ebf30d") : configmap references non-existent config key: ca-bundle.crt Jun 07 16:31:09.762365 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.762036 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.762365 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.762118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.764720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.764693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-web-config\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.765263 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.765238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.766326 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.765873 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.766326 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.766123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff77358-0143-45d4-bb47-570db4ebf30d-config-out\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.766326 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.766281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.766673 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.766623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.766810 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.766777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.767551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.767500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ff77358-0143-45d4-bb47-570db4ebf30d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.767671 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.767627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff77358-0143-45d4-bb47-570db4ebf30d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:09.769801 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:09.769778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvft\" (UniqueName: \"kubernetes.io/projected/7ff77358-0143-45d4-bb47-570db4ebf30d-kube-api-access-jcvft\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:10.266061 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:10.266021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:10.266928 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:10.266903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff77358-0143-45d4-bb47-570db4ebf30d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff77358-0143-45d4-bb47-570db4ebf30d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:10.498503 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:10.498464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 07 16:31:10.714108 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:10.714022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" event={"ID":"1dbceb28-b110-4972-9b4b-4330770c9b6d","Type":"ContainerStarted","Data":"d2d734cc2411604eda7c9865b1b05312a25cb8e0a19293a850713e484a3ce7b1"} Jun 07 16:31:10.734360 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:10.734303 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fz2gn" podStartSLOduration=1.806426546 podStartE2EDuration="2.734282227s" totalImagesPullingTime="927.855681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:10.732502324 +0000 UTC m=+240.135850996" watchObservedRunningTime="2026-06-07 16:31:10.734282227 +0000 UTC m=+240.137630899" Jun 07 16:31:11.018672 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.018649 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 07 16:31:11.416159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.416126 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:11.480278 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.480224 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:11.483998 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.483973 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64445f44f4-4nlp2"] Jun 07 16:31:11.488448 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.488427 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.491144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.490903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 07 16:31:11.491144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.491008 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 07 16:31:11.491144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.491021 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2t5wv\"" Jun 07 16:31:11.491144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.491033 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 07 16:31:11.491144 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.490907 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 07 16:31:11.491457 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.491264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 07 16:31:11.491457 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.491295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4u3gh17879nir\"" Jun 07 16:31:11.498505 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.498484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64445f44f4-4nlp2"] Jun 07 16:31:11.575947 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.575915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-tls\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.575962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-grpc-tls\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.575987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.576044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.576114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.576166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.576186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9ef99cf-fd11-4699-bbee-511f6b2204bb-metrics-client-ca\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.576295 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.576203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwlcw\" (UniqueName: \"kubernetes.io/projected/c9ef99cf-fd11-4699-bbee-511f6b2204bb-kube-api-access-fwlcw\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.676718 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.676718 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9ef99cf-fd11-4699-bbee-511f6b2204bb-metrics-client-ca\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.676901 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwlcw\" (UniqueName: \"kubernetes.io/projected/c9ef99cf-fd11-4699-bbee-511f6b2204bb-kube-api-access-fwlcw\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.676901 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-tls\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.676901 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-grpc-tls\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.677037 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.677037 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.676967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.677125 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.677047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.677451 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.677421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9ef99cf-fd11-4699-bbee-511f6b2204bb-metrics-client-ca\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.679727 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.679684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.680066 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.680047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.680185 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.680163 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.680245 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.680227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-tls\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.680341 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.680323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-grpc-tls\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.680521 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.680503 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9ef99cf-fd11-4699-bbee-511f6b2204bb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.684533 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.684510 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwlcw\" (UniqueName: \"kubernetes.io/projected/c9ef99cf-fd11-4699-bbee-511f6b2204bb-kube-api-access-fwlcw\") pod \"thanos-querier-64445f44f4-4nlp2\" (UID: \"c9ef99cf-fd11-4699-bbee-511f6b2204bb\") " pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.720021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.719932 2561 generic.go:356] "Generic (PLEG): container finished" podID="b68e96f5-8178-47e8-a37a-522d103dd16b" containerID="4f250450139ce0fb97c7af11cd51e6135128c8b8a040f423fdf7be0d833e4ba1" exitCode=0 Jun 07 16:31:11.720021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.719970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6sjh" event={"ID":"b68e96f5-8178-47e8-a37a-522d103dd16b","Type":"ContainerDied","Data":"4f250450139ce0fb97c7af11cd51e6135128c8b8a040f423fdf7be0d833e4ba1"} Jun 07 16:31:11.722653 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.722604 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" event={"ID":"c9231e5a-a75f-4edf-a1ea-277811ae4ba5","Type":"ContainerStarted","Data":"87a32014336b1bf71decb71835703ec82e9eabc340fe736840698f9a1292b109"} Jun 07 16:31:11.722741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.722671 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" event={"ID":"c9231e5a-a75f-4edf-a1ea-277811ae4ba5","Type":"ContainerStarted","Data":"614f48e6ce8fc1dfab8e954930de67c12819bb988aa883e2a86ce2818541dfb8"} Jun 07 16:31:11.722741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.722733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" event={"ID":"c9231e5a-a75f-4edf-a1ea-277811ae4ba5","Type":"ContainerStarted","Data":"2fb4ecce8cbc839a7a8396e669b6a0bffb2038d0e6071228c9ea1c9aea23b72a"} Jun 07 16:31:11.723812 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.723793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"b2379c073366c3defe8ab47c14cd7442f50c9242d4b61c883e66e42c2fec1947"} Jun 07 16:31:11.800090 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.800066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:11.933081 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:11.932964 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:12.065353 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.065291 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:12.124444 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.124394 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6nh8f" podStartSLOduration=2.838435995 podStartE2EDuration="4.124377029s" totalImagesPullingTime="1.285941034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:11.752944081 +0000 UTC m=+241.156292752" watchObservedRunningTime="2026-06-07 16:31:12.124377029 +0000 UTC m=+241.527725699" Jun 07 16:31:12.125672 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.125649 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64445f44f4-4nlp2"] Jun 07 16:31:12.127714 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:12.127690 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ef99cf_fd11_4699_bbee_511f6b2204bb.slice/crio-0e0f9ba4a5b06a8a957fa8dfff3514532f9a0a2d6c2f1f460b208d91b199f057 WatchSource:0}: Error finding container 0e0f9ba4a5b06a8a957fa8dfff3514532f9a0a2d6c2f1f460b208d91b199f057: Status 404 returned error can't find the container with id 0e0f9ba4a5b06a8a957fa8dfff3514532f9a0a2d6c2f1f460b208d91b199f057 Jun 07 16:31:12.699058 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.699017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:12.728657 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.728619 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"0e0f9ba4a5b06a8a957fa8dfff3514532f9a0a2d6c2f1f460b208d91b199f057"} Jun 07 16:31:12.730539 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.730515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6sjh" event={"ID":"b68e96f5-8178-47e8-a37a-522d103dd16b","Type":"ContainerStarted","Data":"786f1a2b9a2e8bedcd6e86547e1a97a8128a2b4810c6f4210f8d1d413a439840"} Jun 07 16:31:12.730684 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.730560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6sjh" event={"ID":"b68e96f5-8178-47e8-a37a-522d103dd16b","Type":"ContainerStarted","Data":"d74ee5c3755e4a8670fe4ef9f14c16b827f3ccdc059b56117cb18f55835e8e50"} Jun 07 16:31:12.732003 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.731983 2561 generic.go:356] "Generic (PLEG): container finished" podID="7ff77358-0143-45d4-bb47-570db4ebf30d" containerID="6915db0510a126cb3036d76587bb86b5f0c38c31d99ab03ae1ace5178cf3d5b3" exitCode=0 Jun 07 16:31:12.732082 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.732008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerDied","Data":"6915db0510a126cb3036d76587bb86b5f0c38c31d99ab03ae1ace5178cf3d5b3"} Jun 07 16:31:12.752328 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.752285 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r6sjh" podStartSLOduration=3.233145157 podStartE2EDuration="4.752272875s" totalImagesPullingTime="1.416410452s" totalInitContainerRuntime="102.717266ms" isStatefulPod=true podCreationTimestamp="2026-06-07 16:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:12.751924553 +0000 UTC m=+242.155273246" watchObservedRunningTime="2026-06-07 16:31:12.752272875 +0000 UTC m=+242.155621546" Jun 07 16:31:12.787163 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:12.787129 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:13.290804 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.290722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:13.326957 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.325479 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785bc685f9-rsk24"] Jun 07 16:31:13.329294 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.329243 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.331715 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.331690 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 16:31:13.331875 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.331853 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 16:31:13.331943 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.331883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 16:31:13.332393 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.331709 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 16:31:13.332393 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.332175 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bv9pz\"" Jun 07 16:31:13.332393 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.332175 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 16:31:13.332393 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.332361 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 16:31:13.333000 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.332846 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 16:31:13.338117 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.337963 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 16:31:13.341807 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.341785 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785bc685f9-rsk24"] Jun 07 16:31:13.362582 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.362540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:13.391939 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.391907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7td7\" (UniqueName: \"kubernetes.io/projected/96f27289-4bb3-4781-b64f-59378d12a2d3-kube-api-access-n7td7\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.392082 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.391958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-console-config\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.392082 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.391996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-serving-cert\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.392082 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.392025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-service-ca\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.392082 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.392068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-trusted-ca-bundle\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.392304 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.392111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-oauth-serving-cert\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.392304 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.392220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-oauth-config\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.491345 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.491315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:13.493675 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7td7\" (UniqueName: \"kubernetes.io/projected/96f27289-4bb3-4781-b64f-59378d12a2d3-kube-api-access-n7td7\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.493803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-console-config\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.493803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-serving-cert\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.493803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-service-ca\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.493803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-trusted-ca-bundle\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.493803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-oauth-serving-cert\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.494059 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.493892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-oauth-config\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.494656 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.494501 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-console-config\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.494656 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.494517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-service-ca\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.494814 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.494670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-oauth-serving-cert\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.495772 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.495748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-trusted-ca-bundle\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.497029 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.497011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-serving-cert\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.497117 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.497047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-oauth-config\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.503689 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.503669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7td7\" (UniqueName: \"kubernetes.io/projected/96f27289-4bb3-4781-b64f-59378d12a2d3-kube-api-access-n7td7\") pod \"console-785bc685f9-rsk24\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:13.517360 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.517336 2561 patch_prober.go:28] interesting pod/image-registry-66c94685c9-rwhbx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:13.517435 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.517389 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:13.644693 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:13.644602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:14.709769 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.709732 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:14.731497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.731322 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785bc685f9-rsk24"] Jun 07 16:31:14.735684 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:14.735620 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f27289_4bb3_4781_b64f_59378d12a2d3.slice/crio-4e387e2e35de6d02e5ccda91c53c7ee08cff83321127808d2256414432812539 WatchSource:0}: Error finding container 4e387e2e35de6d02e5ccda91c53c7ee08cff83321127808d2256414432812539: Status 404 returned error can't find the container with id 4e387e2e35de6d02e5ccda91c53c7ee08cff83321127808d2256414432812539 Jun 07 16:31:14.745823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.745161 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc685f9-rsk24" event={"ID":"96f27289-4bb3-4781-b64f-59378d12a2d3","Type":"ContainerStarted","Data":"4e387e2e35de6d02e5ccda91c53c7ee08cff83321127808d2256414432812539"} Jun 07 16:31:14.748243 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.748213 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"426815110cc4957e9976467bddbfba564b31dc82a5b42c2dc7be1c67b62b81b9"} Jun 07 16:31:14.748355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.748289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"4ef1461e7e0b3ae77845c216bf5d2fab78e05541b92c1b4f4f4f76526988007a"} Jun 07 16:31:14.755567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.755204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"f8c26ae30504c57c8f6f732acb366610a2710d60976856c6a8f5e5d1c1ff4780"} Jun 07 16:31:14.755567 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:14.755279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"5f055594a15b1f49d2b3be855283adc7f7a64416c93cbfd12c8346e9d729b12d"} Jun 07 16:31:15.403748 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.403682 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:15.498931 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.498506 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:15.765243 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.765185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"703866ff62f89168a97a65db8c0ac7b1fb1460376b75530beec11d8c916982a7"} Jun 07 16:31:15.765593 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.765381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"685f326532fcd23d2f33ac4deca99a70326e5234defaad30139c01e15a3eddde"} Jun 07 16:31:15.765593 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.765433 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"2426c2c179df8c88eeca4a63ba47a04f11b748805ee0c3122f0f589268aba1c0"} Jun 07 16:31:15.770682 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.770658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"2c159aafe67c9ba2bc6e503d84486d414f5f5336fdbef0a839c0b2f74681e656"} Jun 07 16:31:15.770773 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.770715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"eae51cb46a304563319e67bdeea61465d7275098f71e61bb6b7349591eaa791f"} Jun 07 16:31:15.770773 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.770748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"6737b4ee72e7333f2a7ea24abb0fbf1308bd2c8a9e5721802dc03a83d01c42aa"} Jun 07 16:31:15.770886 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.770781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff77358-0143-45d4-bb47-570db4ebf30d","Type":"ContainerStarted","Data":"b486f6d8ac5e749fb9fd464db83ef58bf3a6e3194d56fa953f10fe7dd8b54292"} Jun 07 16:31:15.795926 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:15.795875 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.2617178239999998 podStartE2EDuration="6.795855403s" totalImagesPullingTime="3.513191835s" totalInitContainerRuntime="20.945744ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:15.794330303 +0000 UTC m=+245.197678975" watchObservedRunningTime="2026-06-07 16:31:15.795855403 +0000 UTC m=+245.199204074" Jun 07 16:31:16.778187 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:16.778148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" event={"ID":"c9ef99cf-fd11-4699-bbee-511f6b2204bb","Type":"ContainerStarted","Data":"535a6293d250bddd5e801fa640c547553376d05f7fe39590be40aa1f3a261d36"} Jun 07 16:31:16.778815 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:16.778796 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:16.801021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:16.800971 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" podStartSLOduration=2.596354496 podStartE2EDuration="5.800957487s" totalImagesPullingTime="3.204602991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:16.799331863 +0000 UTC m=+246.202680536" watchObservedRunningTime="2026-06-07 16:31:16.800957487 +0000 UTC m=+246.204306178" Jun 07 16:31:17.783293 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:17.783260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc685f9-rsk24" event={"ID":"96f27289-4bb3-4781-b64f-59378d12a2d3","Type":"ContainerStarted","Data":"98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3"} Jun 07 16:31:17.800238 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:17.800189 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785bc685f9-rsk24" podStartSLOduration=1.9330856490000001 podStartE2EDuration="4.800174135s" totalImagesPullingTime="2.867088486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:17.798808277 +0000 UTC m=+247.202156949" watchObservedRunningTime="2026-06-07 16:31:17.800174135 +0000 UTC m=+247.203522805" Jun 07 16:31:18.539081 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.539020 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerName="registry" containerID="cri-o://6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc" gracePeriod=30 Jun 07 16:31:18.774763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.774741 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:31:18.787894 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.787861 2561 generic.go:356] "Generic (PLEG): container finished" podID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerID="6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc" exitCode=0 Jun 07 16:31:18.787894 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.787893 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" Jun 07 16:31:18.788255 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.787917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" event={"ID":"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f","Type":"ContainerDied","Data":"6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc"} Jun 07 16:31:18.788255 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.787982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66c94685c9-rwhbx" event={"ID":"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f","Type":"ContainerDied","Data":"f0cdcc22ddf39caaed9d6a941d7d33b505895fd13715673c9cc1a5095adea13e"} Jun 07 16:31:18.788255 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.788003 2561 scope.go:117] "RemoveContainer" containerID="6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc" Jun 07 16:31:18.796992 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.796970 2561 scope.go:117] "RemoveContainer" containerID="6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc" Jun 07 16:31:18.797288 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:18.797262 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc\": container with ID starting with 6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc not found: ID does not exist" containerID="6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc" Jun 07 16:31:18.797382 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.797296 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc"} err="failed to get container status \"6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc\": rpc error: code = NotFound desc = could not find container \"6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc\": container with ID starting with 6a17ac17ccb8faf9137e2607c8dbe3438bceb28d1796faea00eef9efa90cecbc not found: ID does not exist" Jun 07 16:31:18.848751 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848731 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-ca-trust-extracted\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.848866 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848785 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-bound-sa-token\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.848866 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848806 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.848866 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848846 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-trusted-ca\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.849014 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848875 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-certificates\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.849014 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848893 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnx7c\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-kube-api-access-vnx7c\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.849014 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848928 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-installation-pull-secrets\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.849014 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.848957 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-image-registry-private-configuration\") pod \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\" (UID: \"2d914aaf-9c63-4c0f-b6e1-6257f8463e4f\") " Jun 07 16:31:18.849625 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.849404 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:31:18.849815 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.849752 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:31:18.851358 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.851331 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:31:18.851358 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.851341 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:31:18.851856 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.851837 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:31:18.851950 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.851916 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:31:18.852012 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.851992 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-kube-api-access-vnx7c" (OuterVolumeSpecName: "kube-api-access-vnx7c") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "kube-api-access-vnx7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:31:18.857479 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.857456 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" (UID: "2d914aaf-9c63-4c0f-b6e1-6257f8463e4f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:31:18.950300 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950272 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-installation-pull-secrets\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950308 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-image-registry-private-configuration\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950324 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-ca-trust-extracted\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950335 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-bound-sa-token\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950344 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-tls\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950352 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-trusted-ca\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950360 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-registry-certificates\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:18.950390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:18.950369 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnx7c\" (UniqueName: \"kubernetes.io/projected/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f-kube-api-access-vnx7c\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:31:19.103625 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:19.103547 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66c94685c9-rwhbx"] Jun 07 16:31:19.107509 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:19.107476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:19.108067 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:19.108051 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66c94685c9-rwhbx"] Jun 07 16:31:19.207391 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:19.207341 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:20.993807 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:20.993777 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" path="/var/lib/kubelet/pods/2d914aaf-9c63-4c0f-b6e1-6257f8463e4f/volumes" Jun 07 16:31:22.790217 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:22.790193 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64445f44f4-4nlp2" Jun 07 16:31:22.984028 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:22.983995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:31:22.986279 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:22.986248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfea8106-9ac0-4427-a1f1-d94b5776d1ab-metrics-certs\") pod \"network-metrics-daemon-hs6wc\" (UID: \"dfea8106-9ac0-4427-a1f1-d94b5776d1ab\") " pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:31:23.191693 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.191612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6ng2d\"" Jun 07 16:31:23.199471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.199457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs6wc" Jun 07 16:31:23.336034 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.335938 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hs6wc"] Jun 07 16:31:23.338501 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:23.338473 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfea8106_9ac0_4427_a1f1_d94b5776d1ab.slice/crio-f95b1cad8f6ce0b08cfbcc388cd4d6445c5425eaec29a71d15b91967f8b7aac4 WatchSource:0}: Error finding container f95b1cad8f6ce0b08cfbcc388cd4d6445c5425eaec29a71d15b91967f8b7aac4: Status 404 returned error can't find the container with id f95b1cad8f6ce0b08cfbcc388cd4d6445c5425eaec29a71d15b91967f8b7aac4 Jun 07 16:31:23.644985 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.644951 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:23.645180 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.645161 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:31:23.646934 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.646615 2561 patch_prober.go:28] interesting pod/console-785bc685f9-rsk24 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 07 16:31:23.646934 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.646693 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-785bc685f9-rsk24" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 07 16:31:23.813357 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:23.811569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hs6wc" event={"ID":"dfea8106-9ac0-4427-a1f1-d94b5776d1ab","Type":"ContainerStarted","Data":"f95b1cad8f6ce0b08cfbcc388cd4d6445c5425eaec29a71d15b91967f8b7aac4"} Jun 07 16:31:24.819065 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:24.819024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hs6wc" event={"ID":"dfea8106-9ac0-4427-a1f1-d94b5776d1ab","Type":"ContainerStarted","Data":"e20e01804f192fbb8b2d613da9bc1641aba01b897a600704c2602895925f0120"} Jun 07 16:31:24.819528 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:24.819089 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hs6wc" event={"ID":"dfea8106-9ac0-4427-a1f1-d94b5776d1ab","Type":"ContainerStarted","Data":"6883e7f090e070dde5a6b355a70ff9dd5495e4b7711646ba58f1b5433a9a440d"} Jun 07 16:31:24.833695 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:24.833587 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hs6wc" podStartSLOduration=253.012697816 podStartE2EDuration="4m13.833570552s" totalImagesPullingTime="820.872736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:24.833200809 +0000 UTC m=+254.236549479" watchObservedRunningTime="2026-06-07 16:31:24.833570552 +0000 UTC m=+254.236919223" Jun 07 16:31:24.914530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:24.914501 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:24.975648 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:24.975610 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:28.105706 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:28.105664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:28.207169 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:28.207136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:28.675924 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:28.675897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:28.732388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:28.732345 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:31.621559 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:31.621525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:33.645696 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:33.645663 2561 patch_prober.go:28] interesting pod/console-785bc685f9-rsk24 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 07 16:31:33.646062 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:33.645714 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-785bc685f9-rsk24" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 07 16:31:34.525763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:34.525730 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:34.580568 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:34.580532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:38.198011 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:38.197979 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:43.645686 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:43.645625 2561 patch_prober.go:28] interesting pod/console-785bc685f9-rsk24 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 07 16:31:43.646057 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:43.645708 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-785bc685f9-rsk24" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 07 16:31:43.894134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:43.894105 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6b264de-e198-4442-b5a3-88b6d3d19e05" containerID="ece29c50253006c8bcf909ecee21d3b0115f2a2d80dde120aef5038c7aab7468" exitCode=0 Jun 07 16:31:43.894278 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:43.894179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" event={"ID":"a6b264de-e198-4442-b5a3-88b6d3d19e05","Type":"ContainerDied","Data":"ece29c50253006c8bcf909ecee21d3b0115f2a2d80dde120aef5038c7aab7468"} Jun 07 16:31:43.894478 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:43.894466 2561 scope.go:117] "RemoveContainer" containerID="ece29c50253006c8bcf909ecee21d3b0115f2a2d80dde120aef5038c7aab7468" Jun 07 16:31:44.904765 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:44.904728 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vwbwz" event={"ID":"a6b264de-e198-4442-b5a3-88b6d3d19e05","Type":"ContainerStarted","Data":"9b4c781909bb0b8c8ec82096fcef81dae08012e003effb2e7e2be28b49083033"} Jun 07 16:31:47.703201 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:47.703164 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:52.453553 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:31:52.453494 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hlb9x" podUID="452f1216-275f-4bf0-ba3f-5b713d478237" Jun 07 16:31:52.936826 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:52.936794 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlb9x" Jun 07 16:31:53.646024 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:53.645989 2561 patch_prober.go:28] interesting pod/console-785bc685f9-rsk24 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 07 16:31:53.646467 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:53.646055 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-785bc685f9-rsk24" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 07 16:31:55.324433 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:55.324385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:31:55.326793 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:55.326775 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/452f1216-275f-4bf0-ba3f-5b713d478237-metrics-tls\") pod \"dns-default-hlb9x\" (UID: \"452f1216-275f-4bf0-ba3f-5b713d478237\") " pod="openshift-dns/dns-default-hlb9x" Jun 07 16:31:55.340690 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:55.340670 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bl7z8\"" Jun 07 16:31:55.347863 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:55.347845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlb9x" Jun 07 16:31:55.477410 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:55.477375 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hlb9x"] Jun 07 16:31:55.479778 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:31:55.479751 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452f1216_275f_4bf0_ba3f_5b713d478237.slice/crio-6e16f5311b40c6383db87edbfe36d8f4a469c4915a43f14a771d6d350a14b729 WatchSource:0}: Error finding container 6e16f5311b40c6383db87edbfe36d8f4a469c4915a43f14a771d6d350a14b729: Status 404 returned error can't find the container with id 6e16f5311b40c6383db87edbfe36d8f4a469c4915a43f14a771d6d350a14b729 Jun 07 16:31:55.949279 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:55.949239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlb9x" event={"ID":"452f1216-275f-4bf0-ba3f-5b713d478237","Type":"ContainerStarted","Data":"6e16f5311b40c6383db87edbfe36d8f4a469c4915a43f14a771d6d350a14b729"} Jun 07 16:31:56.046880 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:56.046837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:56.147669 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:56.147612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:57.173609 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.173561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:57.223798 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.223738 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:31:57.292360 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.292340 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/init-config-reloader/0.log" Jun 07 16:31:57.493621 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.493598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/alertmanager/0.log" Jun 07 16:31:57.693118 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.693093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/config-reloader/0.log" Jun 07 16:31:57.892691 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.892607 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/kube-rbac-proxy-web/0.log" Jun 07 16:31:57.959899 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.959867 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlb9x" event={"ID":"452f1216-275f-4bf0-ba3f-5b713d478237","Type":"ContainerStarted","Data":"78de6c4baf74bf65f0ee7342c5ea93d40e182ab69a6fd0b93e20d8817e3f1d26"} Jun 07 16:31:57.960021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.959924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlb9x" event={"ID":"452f1216-275f-4bf0-ba3f-5b713d478237","Type":"ContainerStarted","Data":"4a8d05b478fdb21c1155abf97533a4af968c2e9f18138df35c235b60d0df28d2"} Jun 07 16:31:57.960021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.959966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hlb9x" Jun 07 16:31:57.977181 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:57.977145 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hlb9x" podStartSLOduration=251.526759554 podStartE2EDuration="4m12.977133479s" totalImagesPullingTime="1.450373925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:57.976229326 +0000 UTC m=+287.379578007" watchObservedRunningTime="2026-06-07 16:31:57.977133479 +0000 UTC m=+287.380482149" Jun 07 16:31:58.093653 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:58.093596 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/kube-rbac-proxy/0.log" Jun 07 16:31:58.292899 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:58.292874 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/kube-rbac-proxy-metric/0.log" Jun 07 16:31:58.493592 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:58.493565 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/prom-label-proxy/0.log" Jun 07 16:31:58.695064 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:58.694992 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-q5nd8_8bf01b73-58ae-4418-be8b-c3cd0fc595ab/cluster-monitoring-operator/0.log" Jun 07 16:31:58.894026 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:58.894002 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6nh8f_c9231e5a-a75f-4edf-a1ea-277811ae4ba5/kube-state-metrics/0.log" Jun 07 16:31:59.092880 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:59.092859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6nh8f_c9231e5a-a75f-4edf-a1ea-277811ae4ba5/kube-rbac-proxy-main/0.log" Jun 07 16:31:59.293752 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:31:59.293726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6nh8f_c9231e5a-a75f-4edf-a1ea-277811ae4ba5/kube-rbac-proxy-self/0.log" Jun 07 16:32:00.493105 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:00.493074 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6sjh_b68e96f5-8178-47e8-a37a-522d103dd16b/init-textfile/0.log" Jun 07 16:32:00.693925 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:00.693899 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6sjh_b68e96f5-8178-47e8-a37a-522d103dd16b/node-exporter/0.log" Jun 07 16:32:00.893298 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:00.893231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6sjh_b68e96f5-8178-47e8-a37a-522d103dd16b/kube-rbac-proxy/0.log" Jun 07 16:32:01.693616 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:01.693587 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fz2gn_1dbceb28-b110-4972-9b4b-4330770c9b6d/kube-rbac-proxy-main/0.log" Jun 07 16:32:01.893757 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:01.893729 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fz2gn_1dbceb28-b110-4972-9b4b-4330770c9b6d/kube-rbac-proxy-self/0.log" Jun 07 16:32:02.093574 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:02.093550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fz2gn_1dbceb28-b110-4972-9b4b-4330770c9b6d/openshift-state-metrics/0.log" Jun 07 16:32:03.649209 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:03.649185 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:32:03.652742 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:03.652713 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:32:03.699028 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:03.699006 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-m57sv_88d968de-cf4d-49fb-b915-c86fa9a171ea/prometheus-operator/0.log" Jun 07 16:32:03.818545 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:03.818510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:03.894377 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:03.894346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-m57sv_88d968de-cf4d-49fb-b915-c86fa9a171ea/kube-rbac-proxy/0.log" Jun 07 16:32:04.094335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:04.094313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-c84js_56f2293d-bd50-4152-9f3b-a9010599a439/prometheus-operator-admission-webhook/0.log" Jun 07 16:32:04.293554 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:04.293525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/thanos-query/0.log" Jun 07 16:32:04.492958 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:04.492934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy-web/0.log" Jun 07 16:32:04.693617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:04.693508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy/0.log" Jun 07 16:32:04.893407 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:04.893316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/prom-label-proxy/0.log" Jun 07 16:32:05.093013 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:05.092989 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy-rules/0.log" Jun 07 16:32:05.282035 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:05.282007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:05.292478 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:05.292456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy-metrics/0.log" Jun 07 16:32:05.693788 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:05.693710 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:32:05.894947 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:05.894917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/2.log" Jun 07 16:32:06.092942 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:06.092917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-785bc685f9-rsk24_96f27289-4bb3-4781-b64f-59378d12a2d3/console/0.log" Jun 07 16:32:06.467123 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:06.467052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:06.517585 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:06.517542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:07.493799 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:07.493769 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlb9x_452f1216-275f-4bf0-ba3f-5b713d478237/dns/0.log" Jun 07 16:32:07.693148 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:07.693121 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlb9x_452f1216-275f-4bf0-ba3f-5b713d478237/kube-rbac-proxy/0.log" Jun 07 16:32:07.893769 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:07.893704 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjhsn_42d5ecfd-006a-4b61-accc-df6012082fe4/dns-node-resolver/0.log" Jun 07 16:32:07.965818 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:07.965796 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hlb9x" Jun 07 16:32:08.531912 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:08.531882 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:08.632826 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:08.632801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:09.293355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:09.293320 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf7mk_75deb2a9-94d0-47db-8a2b-2573142d1793/node-ca/0.log" Jun 07 16:32:09.698278 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:09.698189 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b52tw_17513ad6-d53b-4329-92db-436f2f32d90d/serve-healthcheck-canary/0.log" Jun 07 16:32:09.730700 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:09.730672 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:09.815943 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:09.815921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:10.934219 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:10.934193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:32:10.937699 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:10.937677 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:32:10.952360 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:10.952337 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 16:32:15.529437 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:15.529403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:15.635545 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:15.635510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:17.533893 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:17.533858 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:17.581997 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:17.581969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:21.648284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:21.648255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:21.699826 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:21.699796 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:21.822989 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:21.822962 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:21.872809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:21.872786 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:25.543376 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:25.543340 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:25.643536 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:25.643509 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:26.051931 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:26.051898 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:26.112484 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:26.112459 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:27.204579 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:27.204543 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:27.306339 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:27.306311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:27.367759 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:27.367733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:27.687806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:27.687768 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:27.786892 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:27.786851 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:32.659792 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.659759 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:32.761420 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.761388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:32.826388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.826356 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79dc86655b-vnc6r"] Jun 07 16:32:32.826910 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.826851 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerName="registry" Jun 07 16:32:32.826910 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.826888 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerName="registry" Jun 07 16:32:32.827152 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.827001 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d914aaf-9c63-4c0f-b6e1-6257f8463e4f" containerName="registry" Jun 07 16:32:32.831727 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.831701 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.834418 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.834393 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 07 16:32:32.834546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.834428 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 07 16:32:32.834546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.834457 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 07 16:32:32.834546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.834477 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 07 16:32:32.834546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.834498 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 07 16:32:32.834807 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.834787 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fh44s\"" Jun 07 16:32:32.841803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.840584 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 07 16:32:32.844316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.844292 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79dc86655b-vnc6r"] Jun 07 16:32:32.921952 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.921878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.921952 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.921913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-metrics-client-ca\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.922115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.921953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-telemeter-client-tls\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.922115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.921997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dm2\" (UniqueName: \"kubernetes.io/projected/2cc4630b-b536-4152-b1b0-be89fcb8eedf-kube-api-access-l8dm2\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.922115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.922014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-serving-certs-ca-bundle\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.922115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.922039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-secret-telemeter-client\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.922115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.922060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-federate-client-tls\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:32.922115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:32.922084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022375 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-metrics-client-ca\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-telemeter-client-tls\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dm2\" (UniqueName: \"kubernetes.io/projected/2cc4630b-b536-4152-b1b0-be89fcb8eedf-kube-api-access-l8dm2\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-serving-certs-ca-bundle\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022469 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-secret-telemeter-client\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-federate-client-tls\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.022530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.022513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.023216 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.023166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-metrics-client-ca\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.023564 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.023500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-serving-certs-ca-bundle\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.023678 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.023556 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc4630b-b536-4152-b1b0-be89fcb8eedf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.025056 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.025027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-telemeter-client-tls\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.025150 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.025054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.025150 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.025069 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-federate-client-tls\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.025226 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.025176 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2cc4630b-b536-4152-b1b0-be89fcb8eedf-secret-telemeter-client\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.029918 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.029898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dm2\" (UniqueName: \"kubernetes.io/projected/2cc4630b-b536-4152-b1b0-be89fcb8eedf-kube-api-access-l8dm2\") pod \"telemeter-client-79dc86655b-vnc6r\" (UID: \"2cc4630b-b536-4152-b1b0-be89fcb8eedf\") " pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.144735 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.144714 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" Jun 07 16:32:33.278659 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.278621 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79dc86655b-vnc6r"] Jun 07 16:32:33.281173 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:32:33.281147 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc4630b_b536_4152_b1b0_be89fcb8eedf.slice/crio-0e79e4b0962a10218c9d194d90fd019a78bcb6cc73186e416e521bc18d7b7845 WatchSource:0}: Error finding container 0e79e4b0962a10218c9d194d90fd019a78bcb6cc73186e416e521bc18d7b7845: Status 404 returned error can't find the container with id 0e79e4b0962a10218c9d194d90fd019a78bcb6cc73186e416e521bc18d7b7845 Jun 07 16:32:33.283367 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:33.283347 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:32:34.095222 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:34.095185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" event={"ID":"2cc4630b-b536-4152-b1b0-be89fcb8eedf","Type":"ContainerStarted","Data":"0e79e4b0962a10218c9d194d90fd019a78bcb6cc73186e416e521bc18d7b7845"} Jun 07 16:32:36.104360 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.104326 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" event={"ID":"2cc4630b-b536-4152-b1b0-be89fcb8eedf","Type":"ContainerStarted","Data":"b494e2542a0de02ff09e91bb9565acb31194dbd73d204b6f97e9867c78737294"} Jun 07 16:32:36.104739 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.104382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" event={"ID":"2cc4630b-b536-4152-b1b0-be89fcb8eedf","Type":"ContainerStarted","Data":"31ccfd6f00a42494986680ac8a266721b3988596efa728dd2a204d5775c5832f"} Jun 07 16:32:36.104739 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.104401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" event={"ID":"2cc4630b-b536-4152-b1b0-be89fcb8eedf","Type":"ContainerStarted","Data":"77579cc4c934ebbb44bbd4e73be799a1ae6838eba7f92bf1174fb00585ae4285"} Jun 07 16:32:36.126928 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.126876 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79dc86655b-vnc6r" podStartSLOduration=2.360801519 podStartE2EDuration="4.126850231s" totalImagesPullingTime="1.766048712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:32:36.123822432 +0000 UTC m=+325.527171102" watchObservedRunningTime="2026-06-07 16:32:36.126850231 +0000 UTC m=+325.530198902" Jun 07 16:32:36.822531 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.822494 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb68c4747-lpshg"] Jun 07 16:32:36.826353 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.826324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.890030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.889997 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb68c4747-lpshg"] Jun 07 16:32:36.898175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.898150 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:36.950720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.950685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:36.957903 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.957875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-service-ca\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.958031 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.957913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-oauth-serving-cert\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.958031 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.957947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-trusted-ca-bundle\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.958031 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.957973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-config\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.958190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.958041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-serving-cert\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.958190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.958070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr27x\" (UniqueName: \"kubernetes.io/projected/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-kube-api-access-sr27x\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:36.958190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:36.958094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-oauth-config\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.058953 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.058921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-oauth-config\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.058953 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.058960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-service-ca\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.058981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-oauth-serving-cert\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-trusted-ca-bundle\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-config\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-serving-cert\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr27x\" (UniqueName: \"kubernetes.io/projected/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-kube-api-access-sr27x\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059730 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059706 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-oauth-serving-cert\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.059910 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-service-ca\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.060109 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059796 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-config\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.060109 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.059934 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-trusted-ca-bundle\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.062438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.062336 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-serving-cert\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.062438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.062400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-oauth-config\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.066399 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.066380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr27x\" (UniqueName: \"kubernetes.io/projected/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-kube-api-access-sr27x\") pod \"console-7cb68c4747-lpshg\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.136870 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.136794 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:37.291937 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:37.291899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb68c4747-lpshg"] Jun 07 16:32:38.119604 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:38.119572 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb68c4747-lpshg" event={"ID":"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1","Type":"ContainerStarted","Data":"3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed"} Jun 07 16:32:38.119782 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:38.119617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb68c4747-lpshg" event={"ID":"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1","Type":"ContainerStarted","Data":"cb9473d0a16fc1802860c01651d321b39702a9268e4e5506d00d71c6ee97d143"} Jun 07 16:32:38.136928 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:38.136866 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb68c4747-lpshg" podStartSLOduration=2.136850474 podStartE2EDuration="2.136850474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:32:38.134972038 +0000 UTC m=+327.538320705" watchObservedRunningTime="2026-06-07 16:32:38.136850474 +0000 UTC m=+327.540199145" Jun 07 16:32:41.051818 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:41.051778 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:41.103123 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:41.103087 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:42.931672 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:42.931619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:42.988021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:42.987986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:46.898323 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:46.898283 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb68c4747-lpshg"] Jun 07 16:32:46.926114 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:46.926084 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58cc47c76b-zv4xg"] Jun 07 16:32:46.929548 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:46.929528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:46.942070 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:46.942037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cc47c76b-zv4xg"] Jun 07 16:32:47.035837 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035806 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-oauth-serving-cert\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.036025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-serving-cert\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.036025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-oauth-config\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.036025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-trusted-ca-bundle\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.036025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-service-ca\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.036025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkhsv\" (UniqueName: \"kubernetes.io/projected/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-kube-api-access-zkhsv\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.036025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.035972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-config\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.091893 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.091856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:47.136589 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-oauth-serving-cert\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.136809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-serving-cert\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.136809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-oauth-config\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.136809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-trusted-ca-bundle\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.136809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-service-ca\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.136809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkhsv\" (UniqueName: \"kubernetes.io/projected/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-kube-api-access-zkhsv\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.136809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-config\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.137173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.136870 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:32:47.137505 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.137471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-service-ca\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.137651 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.137480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-oauth-serving-cert\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.137651 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.137586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-config\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.137978 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.137951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-trusted-ca-bundle\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.138337 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.138319 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:47.139442 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.139419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-serving-cert\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.139519 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.139476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-oauth-config\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.144070 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.144043 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkhsv\" (UniqueName: \"kubernetes.io/projected/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-kube-api-access-zkhsv\") pod \"console-58cc47c76b-zv4xg\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.238757 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.238600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:47.375940 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.375915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cc47c76b-zv4xg"] Jun 07 16:32:47.378055 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:32:47.378021 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701fcdb2_e9ec_47b4_ac49_8f246b26da9c.slice/crio-0111077cc5d05d5ac6db99c8dfc38026a43ee6f9a405f0db352727dca5b7e24b WatchSource:0}: Error finding container 0111077cc5d05d5ac6db99c8dfc38026a43ee6f9a405f0db352727dca5b7e24b: Status 404 returned error can't find the container with id 0111077cc5d05d5ac6db99c8dfc38026a43ee6f9a405f0db352727dca5b7e24b Jun 07 16:32:47.687778 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.687746 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:47.738436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:47.738406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:48.161462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:48.161427 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cc47c76b-zv4xg" event={"ID":"701fcdb2-e9ec-47b4-ac49-8f246b26da9c","Type":"ContainerStarted","Data":"5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9"} Jun 07 16:32:48.161854 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:48.161510 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cc47c76b-zv4xg" event={"ID":"701fcdb2-e9ec-47b4-ac49-8f246b26da9c","Type":"ContainerStarted","Data":"0111077cc5d05d5ac6db99c8dfc38026a43ee6f9a405f0db352727dca5b7e24b"} Jun 07 16:32:48.178736 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:48.178684 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58cc47c76b-zv4xg" podStartSLOduration=2.178671277 podStartE2EDuration="2.178671277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:32:48.176935585 +0000 UTC m=+337.580284256" watchObservedRunningTime="2026-06-07 16:32:48.178671277 +0000 UTC m=+337.582020015" Jun 07 16:32:49.922104 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:49.922069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:49.967848 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:49.967816 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:56.053016 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:56.052989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:56.152946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:56.152919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:56.253058 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:56.253032 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:57.239467 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:57.239436 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:57.239962 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:57.239502 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:57.244044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:57.244021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:58.210196 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:58.210169 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:32:58.252385 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:58.252357 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785bc685f9-rsk24"] Jun 07 16:32:58.348833 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:58.348803 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:32:58.401954 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:32:58.401927 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:33:11.918608 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:11.918565 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cb68c4747-lpshg" podUID="9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" containerName="console" containerID="cri-o://3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed" gracePeriod=15 Jun 07 16:33:12.177614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.177554 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:33:12.225966 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.225941 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-serving-cert\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226110 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.225993 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-oauth-serving-cert\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226110 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226021 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-config\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226110 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226038 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-service-ca\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226110 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226053 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-oauth-config\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226110 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226082 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr27x\" (UniqueName: \"kubernetes.io/projected/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-kube-api-access-sr27x\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226361 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226123 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-trusted-ca-bundle\") pod \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\" (UID: \"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1\") " Jun 07 16:33:12.226573 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226544 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-service-ca" (OuterVolumeSpecName: "service-ca") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:12.226714 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226603 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-config" (OuterVolumeSpecName: "console-config") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:12.226714 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226620 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:12.226811 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.226792 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:12.228337 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.228310 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:33:12.228424 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.228329 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:33:12.228424 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.228349 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-kube-api-access-sr27x" (OuterVolumeSpecName: "kube-api-access-sr27x") pod "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" (UID: "9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1"). InnerVolumeSpecName "kube-api-access-sr27x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:33:12.257117 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.257088 2561 generic.go:356] "Generic (PLEG): container finished" podID="9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" containerID="3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed" exitCode=0 Jun 07 16:33:12.257236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.257137 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb68c4747-lpshg" Jun 07 16:33:12.257236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.257177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb68c4747-lpshg" event={"ID":"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1","Type":"ContainerDied","Data":"3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed"} Jun 07 16:33:12.257236 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.257231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb68c4747-lpshg" event={"ID":"9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1","Type":"ContainerDied","Data":"cb9473d0a16fc1802860c01651d321b39702a9268e4e5506d00d71c6ee97d143"} Jun 07 16:33:12.257343 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.257257 2561 scope.go:117] "RemoveContainer" containerID="3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed" Jun 07 16:33:12.266872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.266845 2561 scope.go:117] "RemoveContainer" containerID="3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed" Jun 07 16:33:12.267130 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:33:12.267112 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed\": container with ID starting with 3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed not found: ID does not exist" containerID="3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed" Jun 07 16:33:12.267206 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.267139 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed"} err="failed to get container status \"3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed\": rpc error: code = NotFound desc = could not find container \"3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed\": container with ID starting with 3ad73fdc3bad29bd9f05fdd73eba777cb1234befa72ca0a5def0d686710e7bed not found: ID does not exist" Jun 07 16:33:12.277869 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.277844 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb68c4747-lpshg"] Jun 07 16:33:12.281384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.281366 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb68c4747-lpshg"] Jun 07 16:33:12.327271 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327248 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-trusted-ca-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.327271 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327269 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-serving-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.327388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327279 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-oauth-serving-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.327388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327288 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-config\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.327388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327296 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-service-ca\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.327388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327303 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-console-oauth-config\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.327388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.327310 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr27x\" (UniqueName: \"kubernetes.io/projected/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1-kube-api-access-sr27x\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:12.993556 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:12.993527 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" path="/var/lib/kubelet/pods/9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1/volumes" Jun 07 16:33:23.274386 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.274314 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-785bc685f9-rsk24" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" containerID="cri-o://98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3" gracePeriod=15 Jun 07 16:33:23.511346 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.511326 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:33:23.612433 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612372 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-trusted-ca-bundle\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612433 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612401 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-oauth-serving-cert\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612446 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-oauth-config\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612464 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-service-ca\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612498 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7td7\" (UniqueName: \"kubernetes.io/projected/96f27289-4bb3-4781-b64f-59378d12a2d3-kube-api-access-n7td7\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612526 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-serving-cert\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612563 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-console-config\") pod \"96f27289-4bb3-4781-b64f-59378d12a2d3\" (UID: \"96f27289-4bb3-4781-b64f-59378d12a2d3\") " Jun 07 16:33:23.612916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612808 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:23.612916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612806 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:23.613032 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.612980 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:23.613072 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.613040 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-console-config" (OuterVolumeSpecName: "console-config") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:33:23.614715 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.614695 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:33:23.614799 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.614753 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:33:23.614865 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.614837 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f27289-4bb3-4781-b64f-59378d12a2d3-kube-api-access-n7td7" (OuterVolumeSpecName: "kube-api-access-n7td7") pod "96f27289-4bb3-4781-b64f-59378d12a2d3" (UID: "96f27289-4bb3-4781-b64f-59378d12a2d3"). InnerVolumeSpecName "kube-api-access-n7td7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:33:23.713341 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713306 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-console-config\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:23.713341 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713339 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-trusted-ca-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:23.713494 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713353 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-oauth-serving-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:23.713494 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713367 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-oauth-config\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:23.713494 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713378 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f27289-4bb3-4781-b64f-59378d12a2d3-service-ca\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:23.713494 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713389 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7td7\" (UniqueName: \"kubernetes.io/projected/96f27289-4bb3-4781-b64f-59378d12a2d3-kube-api-access-n7td7\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:23.713494 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:23.713401 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f27289-4bb3-4781-b64f-59378d12a2d3-console-serving-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:24.303944 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.303913 2561 generic.go:356] "Generic (PLEG): container finished" podID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerID="98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3" exitCode=0 Jun 07 16:33:24.304315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.303953 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785bc685f9-rsk24" Jun 07 16:33:24.304315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.303980 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc685f9-rsk24" event={"ID":"96f27289-4bb3-4781-b64f-59378d12a2d3","Type":"ContainerDied","Data":"98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3"} Jun 07 16:33:24.304315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.304017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785bc685f9-rsk24" event={"ID":"96f27289-4bb3-4781-b64f-59378d12a2d3","Type":"ContainerDied","Data":"4e387e2e35de6d02e5ccda91c53c7ee08cff83321127808d2256414432812539"} Jun 07 16:33:24.304315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.304037 2561 scope.go:117] "RemoveContainer" containerID="98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3" Jun 07 16:33:24.312711 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.312693 2561 scope.go:117] "RemoveContainer" containerID="98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3" Jun 07 16:33:24.312958 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:33:24.312928 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3\": container with ID starting with 98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3 not found: ID does not exist" containerID="98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3" Jun 07 16:33:24.313005 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.312964 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3"} err="failed to get container status \"98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3\": rpc error: code = NotFound desc = could not find container \"98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3\": container with ID starting with 98e841efc5fe0c1481e69b28bf48b24cb2d0b7aadf8c540223e7bf461cd293e3 not found: ID does not exist" Jun 07 16:33:24.323481 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.323463 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785bc685f9-rsk24"] Jun 07 16:33:24.326905 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.326886 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785bc685f9-rsk24"] Jun 07 16:33:24.993648 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:24.993605 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" path="/var/lib/kubelet/pods/96f27289-4bb3-4781-b64f-59378d12a2d3/volumes" Jun 07 16:33:25.214916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:25.214886 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:33:25.271030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:25.270957 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:33:39.895020 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:39.894985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:33:39.994964 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:39.994935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:33:40.506010 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.505979 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx"] Jun 07 16:33:40.506328 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.506316 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" Jun 07 16:33:40.506371 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.506330 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" Jun 07 16:33:40.506371 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.506347 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" containerName="console" Jun 07 16:33:40.506371 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.506353 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" containerName="console" Jun 07 16:33:40.506465 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.506429 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f27289-4bb3-4781-b64f-59378d12a2d3" containerName="console" Jun 07 16:33:40.506465 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.506437 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb0cdf9-4f62-4fbc-8523-dcdec9178fd1" containerName="console" Jun 07 16:33:40.509601 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.509584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.512062 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.512043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:33:40.512159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.512044 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:33:40.512345 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.512332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j8nkm\"" Jun 07 16:33:40.519213 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.519192 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx"] Jun 07 16:33:40.639867 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.639838 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bshs6\" (UniqueName: \"kubernetes.io/projected/ed33a932-76a0-4aff-b66b-376c86e83ac6-kube-api-access-bshs6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.639984 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.639870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.639984 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.639920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.740682 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.740655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bshs6\" (UniqueName: \"kubernetes.io/projected/ed33a932-76a0-4aff-b66b-376c86e83ac6-kube-api-access-bshs6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.740777 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.740684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.740777 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.740720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.741113 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.741089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.741171 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.741096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.755130 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.755094 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bshs6\" (UniqueName: \"kubernetes.io/projected/ed33a932-76a0-4aff-b66b-376c86e83ac6-kube-api-access-bshs6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.819084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.819024 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:40.941482 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:40.941459 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx"] Jun 07 16:33:40.944088 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:33:40.944065 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded33a932_76a0_4aff_b66b_376c86e83ac6.slice/crio-102069eae911322771ad9b8fdd6a543fac78329e7165cc362b2a0770e8adfb83 WatchSource:0}: Error finding container 102069eae911322771ad9b8fdd6a543fac78329e7165cc362b2a0770e8adfb83: Status 404 returned error can't find the container with id 102069eae911322771ad9b8fdd6a543fac78329e7165cc362b2a0770e8adfb83 Jun 07 16:33:41.378212 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:41.378177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" event={"ID":"ed33a932-76a0-4aff-b66b-376c86e83ac6","Type":"ContainerStarted","Data":"102069eae911322771ad9b8fdd6a543fac78329e7165cc362b2a0770e8adfb83"} Jun 07 16:33:47.406784 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:47.406711 2561 generic.go:356] "Generic (PLEG): container finished" podID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerID="9f95481ef6e9776f1d7dc5d172a698c651bb0f5966de992216e8655ad141103f" exitCode=0 Jun 07 16:33:47.406784 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:47.406761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" event={"ID":"ed33a932-76a0-4aff-b66b-376c86e83ac6","Type":"ContainerDied","Data":"9f95481ef6e9776f1d7dc5d172a698c651bb0f5966de992216e8655ad141103f"} Jun 07 16:33:50.421480 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:50.421443 2561 generic.go:356] "Generic (PLEG): container finished" podID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerID="d80bdb8bd8c7bd380255e28479f6c16c29a608488787589e2c30b0199ee9fb01" exitCode=0 Jun 07 16:33:50.421965 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:50.421521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" event={"ID":"ed33a932-76a0-4aff-b66b-376c86e83ac6","Type":"ContainerDied","Data":"d80bdb8bd8c7bd380255e28479f6c16c29a608488787589e2c30b0199ee9fb01"} Jun 07 16:33:58.466280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:58.466244 2561 generic.go:356] "Generic (PLEG): container finished" podID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerID="d8d756b6c64fddd7eaad70300bffc2a2c18ab5048b6b543f10127d9c462f5105" exitCode=0 Jun 07 16:33:58.466280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:58.466284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" event={"ID":"ed33a932-76a0-4aff-b66b-376c86e83ac6","Type":"ContainerDied","Data":"d8d756b6c64fddd7eaad70300bffc2a2c18ab5048b6b543f10127d9c462f5105"} Jun 07 16:33:59.599234 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.599207 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:33:59.698999 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.698966 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-util\") pod \"ed33a932-76a0-4aff-b66b-376c86e83ac6\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " Jun 07 16:33:59.699173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.699018 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bshs6\" (UniqueName: \"kubernetes.io/projected/ed33a932-76a0-4aff-b66b-376c86e83ac6-kube-api-access-bshs6\") pod \"ed33a932-76a0-4aff-b66b-376c86e83ac6\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " Jun 07 16:33:59.699173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.699076 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-bundle\") pod \"ed33a932-76a0-4aff-b66b-376c86e83ac6\" (UID: \"ed33a932-76a0-4aff-b66b-376c86e83ac6\") " Jun 07 16:33:59.699729 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.699708 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-bundle" (OuterVolumeSpecName: "bundle") pod "ed33a932-76a0-4aff-b66b-376c86e83ac6" (UID: "ed33a932-76a0-4aff-b66b-376c86e83ac6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:33:59.701331 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.701305 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed33a932-76a0-4aff-b66b-376c86e83ac6-kube-api-access-bshs6" (OuterVolumeSpecName: "kube-api-access-bshs6") pod "ed33a932-76a0-4aff-b66b-376c86e83ac6" (UID: "ed33a932-76a0-4aff-b66b-376c86e83ac6"). InnerVolumeSpecName "kube-api-access-bshs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:33:59.703555 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.703531 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-util" (OuterVolumeSpecName: "util") pod "ed33a932-76a0-4aff-b66b-376c86e83ac6" (UID: "ed33a932-76a0-4aff-b66b-376c86e83ac6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:33:59.800285 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.800256 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bshs6\" (UniqueName: \"kubernetes.io/projected/ed33a932-76a0-4aff-b66b-376c86e83ac6-kube-api-access-bshs6\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:59.800285 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.800282 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:33:59.800285 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:33:59.800292 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed33a932-76a0-4aff-b66b-376c86e83ac6-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:00.476612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:00.476579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" event={"ID":"ed33a932-76a0-4aff-b66b-376c86e83ac6","Type":"ContainerDied","Data":"102069eae911322771ad9b8fdd6a543fac78329e7165cc362b2a0770e8adfb83"} Jun 07 16:34:00.476806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:00.476628 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="102069eae911322771ad9b8fdd6a543fac78329e7165cc362b2a0770e8adfb83" Jun 07 16:34:00.476806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:00.476615 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpscdx" Jun 07 16:34:06.289780 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:06.289729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:07.656032 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:07.656000 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:08.245577 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.245546 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj"] Jun 07 16:34:08.246045 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246028 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="util" Jun 07 16:34:08.246116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246048 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="util" Jun 07 16:34:08.246116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246073 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="extract" Jun 07 16:34:08.246116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246082 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="extract" Jun 07 16:34:08.246116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246099 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="pull" Jun 07 16:34:08.246116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246109 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="pull" Jun 07 16:34:08.246329 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.246182 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed33a932-76a0-4aff-b66b-376c86e83ac6" containerName="extract" Jun 07 16:34:08.248699 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.248678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.251328 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.251303 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 07 16:34:08.251445 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.251307 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h45f9\"" Jun 07 16:34:08.252447 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.252400 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:34:08.264842 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.264818 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj"] Jun 07 16:34:08.265105 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.265086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jqq\" (UniqueName: \"kubernetes.io/projected/325e6fdd-b50e-4de3-ab5c-1d7947b14d5c-kube-api-access-t4jqq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmszj\" (UID: \"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.265190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.265124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/325e6fdd-b50e-4de3-ab5c-1d7947b14d5c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmszj\" (UID: \"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.365628 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.365599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/325e6fdd-b50e-4de3-ab5c-1d7947b14d5c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmszj\" (UID: \"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.365772 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.365691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jqq\" (UniqueName: \"kubernetes.io/projected/325e6fdd-b50e-4de3-ab5c-1d7947b14d5c-kube-api-access-t4jqq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmszj\" (UID: \"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.365970 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.365952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/325e6fdd-b50e-4de3-ab5c-1d7947b14d5c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmszj\" (UID: \"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.373921 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.373897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jqq\" (UniqueName: \"kubernetes.io/projected/325e6fdd-b50e-4de3-ab5c-1d7947b14d5c-kube-api-access-t4jqq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wmszj\" (UID: \"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.559497 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.559427 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" Jun 07 16:34:08.694720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:08.694574 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj"] Jun 07 16:34:08.697496 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:34:08.697475 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325e6fdd_b50e_4de3_ab5c_1d7947b14d5c.slice/crio-a1b2ebc7c4cf2f050d1a06b7f022bcde8185399bef00477c88fe691b3f29f721 WatchSource:0}: Error finding container a1b2ebc7c4cf2f050d1a06b7f022bcde8185399bef00477c88fe691b3f29f721: Status 404 returned error can't find the container with id a1b2ebc7c4cf2f050d1a06b7f022bcde8185399bef00477c88fe691b3f29f721 Jun 07 16:34:09.517489 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:09.517447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" event={"ID":"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c","Type":"ContainerStarted","Data":"a1b2ebc7c4cf2f050d1a06b7f022bcde8185399bef00477c88fe691b3f29f721"} Jun 07 16:34:09.908365 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:09.908280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:10.009496 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:10.009466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:10.524277 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:10.524245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" event={"ID":"325e6fdd-b50e-4de3-ab5c-1d7947b14d5c","Type":"ContainerStarted","Data":"da22853801be60f7c37c29126e2cddbb664865cef94d7573fda81634a43daf3f"} Jun 07 16:34:10.550488 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:10.550444 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wmszj" podStartSLOduration=1.065165298 podStartE2EDuration="2.550429127s" totalImagesPullingTime="1.485263829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:10.548788147 +0000 UTC m=+419.952136818" watchObservedRunningTime="2026-06-07 16:34:10.550429127 +0000 UTC m=+419.953777796" Jun 07 16:34:10.878271 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:10.878180 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:11.028456 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:11.028427 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:12.310078 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.310020 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm"] Jun 07 16:34:12.312920 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.312903 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.315275 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.315255 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:34:12.315275 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.315268 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:34:12.316917 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.316897 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j8nkm\"" Jun 07 16:34:12.321520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.321500 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm"] Jun 07 16:34:12.401522 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.401499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv66l\" (UniqueName: \"kubernetes.io/projected/26d3465d-f01f-4e09-bd22-10c77f36625f-kube-api-access-fv66l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.401623 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.401557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.401623 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.401601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.461805 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.461784 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s"] Jun 07 16:34:12.463896 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.463882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.466224 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.466204 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 07 16:34:12.466301 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.466280 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 07 16:34:12.466362 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.466348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h8n9l\"" Jun 07 16:34:12.471560 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.471541 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s"] Jun 07 16:34:12.502508 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.502606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7bz6s\" (UID: \"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.502606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.502750 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv66l\" (UniqueName: \"kubernetes.io/projected/26d3465d-f01f-4e09-bd22-10c77f36625f-kube-api-access-fv66l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.502750 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqh5l\" (UniqueName: \"kubernetes.io/projected/f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed-kube-api-access-fqh5l\") pod \"cert-manager-webhook-7dc76cbb94-7bz6s\" (UID: \"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.502918 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.502954 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.502916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.510570 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.510546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv66l\" (UniqueName: \"kubernetes.io/projected/26d3465d-f01f-4e09-bd22-10c77f36625f-kube-api-access-fv66l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.603832 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.603757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7bz6s\" (UID: \"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.603832 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.603806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqh5l\" (UniqueName: \"kubernetes.io/projected/f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed-kube-api-access-fqh5l\") pod \"cert-manager-webhook-7dc76cbb94-7bz6s\" (UID: \"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.612282 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.612260 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7bz6s\" (UID: \"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.612412 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.612395 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqh5l\" (UniqueName: \"kubernetes.io/projected/f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed-kube-api-access-fqh5l\") pod \"cert-manager-webhook-7dc76cbb94-7bz6s\" (UID: \"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.622216 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.622191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:12.747706 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.747684 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm"] Jun 07 16:34:12.749814 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:34:12.749789 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d3465d_f01f_4e09_bd22_10c77f36625f.slice/crio-cbd99df741cb36d21f583cd9e2182a311832c5ddf5349632a26a1d32b0db982b WatchSource:0}: Error finding container cbd99df741cb36d21f583cd9e2182a311832c5ddf5349632a26a1d32b0db982b: Status 404 returned error can't find the container with id cbd99df741cb36d21f583cd9e2182a311832c5ddf5349632a26a1d32b0db982b Jun 07 16:34:12.784439 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.784415 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:12.908174 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:12.908149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s"] Jun 07 16:34:12.910464 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:34:12.910432 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5bc9fb0_bc3e_4f23_a7ef_5df5dadbb4ed.slice/crio-bccded2186885d5ee6e605d37c94c529c1251efeee8440ceba96c787afeb55cc WatchSource:0}: Error finding container bccded2186885d5ee6e605d37c94c529c1251efeee8440ceba96c787afeb55cc: Status 404 returned error can't find the container with id bccded2186885d5ee6e605d37c94c529c1251efeee8440ceba96c787afeb55cc Jun 07 16:34:13.537684 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:13.537627 2561 generic.go:356] "Generic (PLEG): container finished" podID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerID="acf7303c0e5d8c5857e743a2a6cb5dc453a39dcbceaa69dcca284d4a0d6a34fc" exitCode=0 Jun 07 16:34:13.538066 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:13.537733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" event={"ID":"26d3465d-f01f-4e09-bd22-10c77f36625f","Type":"ContainerDied","Data":"acf7303c0e5d8c5857e743a2a6cb5dc453a39dcbceaa69dcca284d4a0d6a34fc"} Jun 07 16:34:13.538066 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:13.537790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" event={"ID":"26d3465d-f01f-4e09-bd22-10c77f36625f","Type":"ContainerStarted","Data":"cbd99df741cb36d21f583cd9e2182a311832c5ddf5349632a26a1d32b0db982b"} Jun 07 16:34:13.539042 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:13.539014 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" event={"ID":"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed","Type":"ContainerStarted","Data":"bccded2186885d5ee6e605d37c94c529c1251efeee8440ceba96c787afeb55cc"} Jun 07 16:34:14.356748 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:14.356713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:14.735231 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:14.735139 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:16.326747 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.326716 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2"] Jun 07 16:34:16.329904 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.329889 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.332267 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.332246 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6f6gj\"" Jun 07 16:34:16.336482 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.336463 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2"] Jun 07 16:34:16.436406 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.436379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghpts\" (UniqueName: \"kubernetes.io/projected/a000ca77-04c2-41c9-832e-9c7669c4fda9-kube-api-access-ghpts\") pod \"cert-manager-cainjector-5d99449ffd-pl4v2\" (UID: \"a000ca77-04c2-41c9-832e-9c7669c4fda9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.436503 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.436415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a000ca77-04c2-41c9-832e-9c7669c4fda9-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pl4v2\" (UID: \"a000ca77-04c2-41c9-832e-9c7669c4fda9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.537087 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.537065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghpts\" (UniqueName: \"kubernetes.io/projected/a000ca77-04c2-41c9-832e-9c7669c4fda9-kube-api-access-ghpts\") pod \"cert-manager-cainjector-5d99449ffd-pl4v2\" (UID: \"a000ca77-04c2-41c9-832e-9c7669c4fda9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.537162 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.537097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a000ca77-04c2-41c9-832e-9c7669c4fda9-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pl4v2\" (UID: \"a000ca77-04c2-41c9-832e-9c7669c4fda9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.544627 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.544608 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a000ca77-04c2-41c9-832e-9c7669c4fda9-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pl4v2\" (UID: \"a000ca77-04c2-41c9-832e-9c7669c4fda9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.544803 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.544783 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghpts\" (UniqueName: \"kubernetes.io/projected/a000ca77-04c2-41c9-832e-9c7669c4fda9-kube-api-access-ghpts\") pod \"cert-manager-cainjector-5d99449ffd-pl4v2\" (UID: \"a000ca77-04c2-41c9-832e-9c7669c4fda9\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.555495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.555473 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" event={"ID":"f5bc9fb0-bc3e-4f23-a7ef-5df5dadbb4ed","Type":"ContainerStarted","Data":"cac38e92651f9c3e88514e4245e8e33bea5d53920ba211e4c4249cd6b74bc433"} Jun 07 16:34:16.555599 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.555562 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:16.570003 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.569962 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" podStartSLOduration=1.3979639 podStartE2EDuration="4.569950829s" totalImagesPullingTime="3.171986929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:16.569019003 +0000 UTC m=+425.972367673" watchObservedRunningTime="2026-06-07 16:34:16.569950829 +0000 UTC m=+425.973299501" Jun 07 16:34:16.638735 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.638683 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" Jun 07 16:34:16.763853 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.763830 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2"] Jun 07 16:34:16.765768 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:34:16.765741 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda000ca77_04c2_41c9_832e_9c7669c4fda9.slice/crio-bf2d226e186150bc2f253be73850d890f5bf1058bd275fe3632d198887434811 WatchSource:0}: Error finding container bf2d226e186150bc2f253be73850d890f5bf1058bd275fe3632d198887434811: Status 404 returned error can't find the container with id bf2d226e186150bc2f253be73850d890f5bf1058bd275fe3632d198887434811 Jun 07 16:34:16.896223 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.896116 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:16.949792 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:16.949761 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:17.561175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:17.561139 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" event={"ID":"a000ca77-04c2-41c9-832e-9c7669c4fda9","Type":"ContainerStarted","Data":"31c284713901677124015a6dfd8f2e62de242af5ed5857d6c868ae143978399f"} Jun 07 16:34:17.561583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:17.561185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" event={"ID":"a000ca77-04c2-41c9-832e-9c7669c4fda9","Type":"ContainerStarted","Data":"bf2d226e186150bc2f253be73850d890f5bf1058bd275fe3632d198887434811"} Jun 07 16:34:17.577914 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:17.577867 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pl4v2" podStartSLOduration=1.5778521620000001 podStartE2EDuration="1.577852162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:17.576565216 +0000 UTC m=+426.979913889" watchObservedRunningTime="2026-06-07 16:34:17.577852162 +0000 UTC m=+426.981200833" Jun 07 16:34:21.581805 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:21.581768 2561 generic.go:356] "Generic (PLEG): container finished" podID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerID="c572d75e0125878f9a3a7efc43d4eaa1243a6b982a4bb66f82f981d7bd15d748" exitCode=0 Jun 07 16:34:21.582187 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:21.581843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" event={"ID":"26d3465d-f01f-4e09-bd22-10c77f36625f","Type":"ContainerDied","Data":"c572d75e0125878f9a3a7efc43d4eaa1243a6b982a4bb66f82f981d7bd15d748"} Jun 07 16:34:21.950691 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:21.950572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:22.563258 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:22.563222 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bz6s" Jun 07 16:34:22.589924 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:22.589897 2561 generic.go:356] "Generic (PLEG): container finished" podID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerID="784cd537b92af3d4b590b0eb324f59e1b742f0e1ae1a5c404dacb37adf54e5de" exitCode=0 Jun 07 16:34:22.590367 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:22.589946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" event={"ID":"26d3465d-f01f-4e09-bd22-10c77f36625f","Type":"ContainerDied","Data":"784cd537b92af3d4b590b0eb324f59e1b742f0e1ae1a5c404dacb37adf54e5de"} Jun 07 16:34:23.728766 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.728742 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:23.797535 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.797502 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-util\") pod \"26d3465d-f01f-4e09-bd22-10c77f36625f\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " Jun 07 16:34:23.797694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.797556 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-bundle\") pod \"26d3465d-f01f-4e09-bd22-10c77f36625f\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " Jun 07 16:34:23.797694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.797601 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv66l\" (UniqueName: \"kubernetes.io/projected/26d3465d-f01f-4e09-bd22-10c77f36625f-kube-api-access-fv66l\") pod \"26d3465d-f01f-4e09-bd22-10c77f36625f\" (UID: \"26d3465d-f01f-4e09-bd22-10c77f36625f\") " Jun 07 16:34:23.797994 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.797965 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-bundle" (OuterVolumeSpecName: "bundle") pod "26d3465d-f01f-4e09-bd22-10c77f36625f" (UID: "26d3465d-f01f-4e09-bd22-10c77f36625f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:34:23.799872 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.799848 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d3465d-f01f-4e09-bd22-10c77f36625f-kube-api-access-fv66l" (OuterVolumeSpecName: "kube-api-access-fv66l") pod "26d3465d-f01f-4e09-bd22-10c77f36625f" (UID: "26d3465d-f01f-4e09-bd22-10c77f36625f"). InnerVolumeSpecName "kube-api-access-fv66l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:34:23.801795 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.801771 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-util" (OuterVolumeSpecName: "util") pod "26d3465d-f01f-4e09-bd22-10c77f36625f" (UID: "26d3465d-f01f-4e09-bd22-10c77f36625f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:34:23.898755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.898672 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:23.898755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.898696 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d3465d-f01f-4e09-bd22-10c77f36625f-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:23.898755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:23.898706 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv66l\" (UniqueName: \"kubernetes.io/projected/26d3465d-f01f-4e09-bd22-10c77f36625f-kube-api-access-fv66l\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:24.600259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:24.600229 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" Jun 07 16:34:24.600259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:24.600255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkdqbm" event={"ID":"26d3465d-f01f-4e09-bd22-10c77f36625f","Type":"ContainerDied","Data":"cbd99df741cb36d21f583cd9e2182a311832c5ddf5349632a26a1d32b0db982b"} Jun 07 16:34:24.600455 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:24.600298 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbd99df741cb36d21f583cd9e2182a311832c5ddf5349632a26a1d32b0db982b" Jun 07 16:34:27.321324 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:27.321298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:27.416685 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:27.416622 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:29.530706 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.530606 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5"] Jun 07 16:34:29.531044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.530957 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="util" Jun 07 16:34:29.531044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.530968 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="util" Jun 07 16:34:29.531044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.530983 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="pull" Jun 07 16:34:29.531044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.530988 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="pull" Jun 07 16:34:29.531044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.531000 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="extract" Jun 07 16:34:29.531044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.531005 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="extract" Jun 07 16:34:29.531221 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.531069 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d3465d-f01f-4e09-bd22-10c77f36625f" containerName="extract" Jun 07 16:34:29.540766 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.540741 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.542618 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.542595 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5"] Jun 07 16:34:29.543462 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.543432 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 16:34:29.544368 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.544345 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:34:29.544470 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.544427 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2tzv5\"" Jun 07 16:34:29.646694 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.646663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef37dc8e-caf6-4100-b4b5-f9e6edd7282c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lz8w5\" (UID: \"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.646817 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.646716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t495j\" (UniqueName: \"kubernetes.io/projected/ef37dc8e-caf6-4100-b4b5-f9e6edd7282c-kube-api-access-t495j\") pod \"openshift-lws-operator-fd8ccff4c-lz8w5\" (UID: \"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.747554 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.747527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef37dc8e-caf6-4100-b4b5-f9e6edd7282c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lz8w5\" (UID: \"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.747686 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.747569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t495j\" (UniqueName: \"kubernetes.io/projected/ef37dc8e-caf6-4100-b4b5-f9e6edd7282c-kube-api-access-t495j\") pod \"openshift-lws-operator-fd8ccff4c-lz8w5\" (UID: \"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.747982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.747964 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef37dc8e-caf6-4100-b4b5-f9e6edd7282c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lz8w5\" (UID: \"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.755533 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.755513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t495j\" (UniqueName: \"kubernetes.io/projected/ef37dc8e-caf6-4100-b4b5-f9e6edd7282c-kube-api-access-t495j\") pod \"openshift-lws-operator-fd8ccff4c-lz8w5\" (UID: \"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.851095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.851030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" Jun 07 16:34:29.984355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:29.984324 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5"] Jun 07 16:34:29.987797 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:34:29.987771 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef37dc8e_caf6_4100_b4b5_f9e6edd7282c.slice/crio-f3c37e4f09fe24d687a2eea5eeaf5564ba2496b99d3c47c365bdf520e1bac572 WatchSource:0}: Error finding container f3c37e4f09fe24d687a2eea5eeaf5564ba2496b99d3c47c365bdf520e1bac572: Status 404 returned error can't find the container with id f3c37e4f09fe24d687a2eea5eeaf5564ba2496b99d3c47c365bdf520e1bac572 Jun 07 16:34:30.633577 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:30.633545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" event={"ID":"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c","Type":"ContainerStarted","Data":"f3c37e4f09fe24d687a2eea5eeaf5564ba2496b99d3c47c365bdf520e1bac572"} Jun 07 16:34:33.654715 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:33.654618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" event={"ID":"ef37dc8e-caf6-4100-b4b5-f9e6edd7282c","Type":"ContainerStarted","Data":"9744a75f03cee1a849f3794fe0233876fe745f3588bca0b08a0bd183daf95fee"} Jun 07 16:34:33.669889 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:33.669839 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz8w5" podStartSLOduration=1.383799947 podStartE2EDuration="4.669824937s" totalImagesPullingTime="3.28602499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:33.667918278 +0000 UTC m=+443.071266951" watchObservedRunningTime="2026-06-07 16:34:33.669824937 +0000 UTC m=+443.073173608" Jun 07 16:34:34.340452 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:34.340415 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:34.441376 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:34.441320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:36.541791 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.541758 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:36.781007 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.780976 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4"] Jun 07 16:34:36.783525 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.783511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:36.786087 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.786066 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:34:36.786208 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.786139 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:34:36.786208 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.786187 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j8nkm\"" Jun 07 16:34:36.792320 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.792267 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4"] Jun 07 16:34:36.911378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.911343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:36.911378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.911380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:36.911582 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:36.911425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5kf2\" (UniqueName: \"kubernetes.io/projected/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-kube-api-access-z5kf2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.011763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.011736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.011763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.011766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.011947 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.011801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kf2\" (UniqueName: \"kubernetes.io/projected/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-kube-api-access-z5kf2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.012096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.012077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.012131 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.012103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.020262 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.020231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5kf2\" (UniqueName: \"kubernetes.io/projected/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-kube-api-access-z5kf2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.093257 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.093203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:37.217073 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.216984 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4"] Jun 07 16:34:37.219308 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:34:37.219286 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb048c6_a305_43dc_82ab_7dd1dc6782cb.slice/crio-309464ebca7030299828b5ca7020d6926e964df9503cdfc22564a2e1178118d6 WatchSource:0}: Error finding container 309464ebca7030299828b5ca7020d6926e964df9503cdfc22564a2e1178118d6: Status 404 returned error can't find the container with id 309464ebca7030299828b5ca7020d6926e964df9503cdfc22564a2e1178118d6 Jun 07 16:34:37.675476 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.675444 2561 generic.go:356] "Generic (PLEG): container finished" podID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerID="6b1023c726179a0fef87c774f099ae7d8c83c86d98396d80da75c4e8ef07aa94" exitCode=0 Jun 07 16:34:37.676005 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.675543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" event={"ID":"9bb048c6-a305-43dc-82ab-7dd1dc6782cb","Type":"ContainerDied","Data":"6b1023c726179a0fef87c774f099ae7d8c83c86d98396d80da75c4e8ef07aa94"} Jun 07 16:34:37.676005 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:37.675604 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" event={"ID":"9bb048c6-a305-43dc-82ab-7dd1dc6782cb","Type":"ContainerStarted","Data":"309464ebca7030299828b5ca7020d6926e964df9503cdfc22564a2e1178118d6"} Jun 07 16:34:38.682298 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:38.682223 2561 generic.go:356] "Generic (PLEG): container finished" podID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerID="3ed5907fda3e2b60757015559a236574da2750f0652a719f188f8bafe1b60623" exitCode=0 Jun 07 16:34:38.682298 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:38.682267 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" event={"ID":"9bb048c6-a305-43dc-82ab-7dd1dc6782cb","Type":"ContainerDied","Data":"3ed5907fda3e2b60757015559a236574da2750f0652a719f188f8bafe1b60623"} Jun 07 16:34:39.688998 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:39.688967 2561 generic.go:356] "Generic (PLEG): container finished" podID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerID="610acb342222ec8fadca1559b2b34488575f3cf3a22cdc89dc34df079b57e9b0" exitCode=0 Jun 07 16:34:39.689353 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:39.689058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" event={"ID":"9bb048c6-a305-43dc-82ab-7dd1dc6782cb","Type":"ContainerDied","Data":"610acb342222ec8fadca1559b2b34488575f3cf3a22cdc89dc34df079b57e9b0"} Jun 07 16:34:40.820140 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.820118 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:40.945006 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.944936 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-util\") pod \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " Jun 07 16:34:40.945006 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.944993 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5kf2\" (UniqueName: \"kubernetes.io/projected/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-kube-api-access-z5kf2\") pod \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " Jun 07 16:34:40.945207 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.945049 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-bundle\") pod \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\" (UID: \"9bb048c6-a305-43dc-82ab-7dd1dc6782cb\") " Jun 07 16:34:40.945745 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.945721 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-bundle" (OuterVolumeSpecName: "bundle") pod "9bb048c6-a305-43dc-82ab-7dd1dc6782cb" (UID: "9bb048c6-a305-43dc-82ab-7dd1dc6782cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:34:40.947160 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.947136 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-kube-api-access-z5kf2" (OuterVolumeSpecName: "kube-api-access-z5kf2") pod "9bb048c6-a305-43dc-82ab-7dd1dc6782cb" (UID: "9bb048c6-a305-43dc-82ab-7dd1dc6782cb"). InnerVolumeSpecName "kube-api-access-z5kf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:34:40.950099 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:40.950078 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-util" (OuterVolumeSpecName: "util") pod "9bb048c6-a305-43dc-82ab-7dd1dc6782cb" (UID: "9bb048c6-a305-43dc-82ab-7dd1dc6782cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:34:41.046157 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.046129 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:41.046157 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.046161 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:41.046373 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.046200 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5kf2\" (UniqueName: \"kubernetes.io/projected/9bb048c6-a305-43dc-82ab-7dd1dc6782cb-kube-api-access-z5kf2\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:34:41.206591 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.206472 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:41.273297 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.273272 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:41.701153 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.701128 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" Jun 07 16:34:41.701291 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.701130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbdb4" event={"ID":"9bb048c6-a305-43dc-82ab-7dd1dc6782cb","Type":"ContainerDied","Data":"309464ebca7030299828b5ca7020d6926e964df9503cdfc22564a2e1178118d6"} Jun 07 16:34:41.701291 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:41.701240 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="309464ebca7030299828b5ca7020d6926e964df9503cdfc22564a2e1178118d6" Jun 07 16:34:48.145909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:48.145880 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:48.244411 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:48.244380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:48.806283 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:48.806250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:49.298488 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.298460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:49.411284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.411254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:49.506242 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506212 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66"] Jun 07 16:34:49.506606 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506589 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="util" Jun 07 16:34:49.506707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506608 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="util" Jun 07 16:34:49.506707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506626 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="extract" Jun 07 16:34:49.506707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506657 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="extract" Jun 07 16:34:49.506707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506675 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="pull" Jun 07 16:34:49.506707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506685 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="pull" Jun 07 16:34:49.506955 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.506794 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bb048c6-a305-43dc-82ab-7dd1dc6782cb" containerName="extract" Jun 07 16:34:49.511005 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.510985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.513822 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.513800 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 16:34:49.513946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.513933 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 16:34:49.514020 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.513982 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ff967\"" Jun 07 16:34:49.514234 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.514220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 16:34:49.516973 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.516954 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 16:34:49.546756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.546731 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66"] Jun 07 16:34:49.610569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.610537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e700862f-c24b-4274-8a33-dcc235e44c81-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.610569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.610574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e700862f-c24b-4274-8a33-dcc235e44c81-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.610756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.610620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv59s\" (UniqueName: \"kubernetes.io/projected/e700862f-c24b-4274-8a33-dcc235e44c81-kube-api-access-cv59s\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.610756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.610699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e700862f-c24b-4274-8a33-dcc235e44c81-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.610756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.610726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e700862f-c24b-4274-8a33-dcc235e44c81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.711479 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.711449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e700862f-c24b-4274-8a33-dcc235e44c81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.711625 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.711512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e700862f-c24b-4274-8a33-dcc235e44c81-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.711625 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.711539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e700862f-c24b-4274-8a33-dcc235e44c81-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.711625 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.711572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv59s\" (UniqueName: \"kubernetes.io/projected/e700862f-c24b-4274-8a33-dcc235e44c81-kube-api-access-cv59s\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.711625 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.711607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e700862f-c24b-4274-8a33-dcc235e44c81-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.712038 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.712014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e700862f-c24b-4274-8a33-dcc235e44c81-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.713918 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.713898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e700862f-c24b-4274-8a33-dcc235e44c81-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.714139 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.714122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e700862f-c24b-4274-8a33-dcc235e44c81-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.714201 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.714159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e700862f-c24b-4274-8a33-dcc235e44c81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.718751 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.718730 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:49.725441 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.725424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv59s\" (UniqueName: \"kubernetes.io/projected/e700862f-c24b-4274-8a33-dcc235e44c81-kube-api-access-cv59s\") pod \"opendatahub-operator-controller-manager-768db79f96-gtp66\" (UID: \"e700862f-c24b-4274-8a33-dcc235e44c81\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.820774 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.820711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:49.884825 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:49.884795 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:50.005599 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.005561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66"] Jun 07 16:34:50.045437 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.045309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:50.142656 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.142561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:50.250051 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.249997 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:50.351294 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.351268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:50.454006 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.453940 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:50.746787 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:50.746738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" event={"ID":"e700862f-c24b-4274-8a33-dcc235e44c81","Type":"ContainerStarted","Data":"0df3c9ba1d80c3592794729d479ee2f30573650aad8840ddece5ddd59cb707c4"} Jun 07 16:34:53.763212 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:53.763181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" event={"ID":"e700862f-c24b-4274-8a33-dcc235e44c81","Type":"ContainerStarted","Data":"d5c495141587f903ad207a8f2383b0cbfb484bab905569129885c8db8e5f2736"} Jun 07 16:34:54.769134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:54.769096 2561 generic.go:356] "Generic (PLEG): container finished" podID="e700862f-c24b-4274-8a33-dcc235e44c81" containerID="d5c495141587f903ad207a8f2383b0cbfb484bab905569129885c8db8e5f2736" exitCode=0 Jun 07 16:34:54.769573 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:54.769185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" event={"ID":"e700862f-c24b-4274-8a33-dcc235e44c81","Type":"ContainerDied","Data":"d5c495141587f903ad207a8f2383b0cbfb484bab905569129885c8db8e5f2736"} Jun 07 16:34:55.775682 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:55.775622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" event={"ID":"e700862f-c24b-4274-8a33-dcc235e44c81","Type":"ContainerStarted","Data":"a41fce47abb954c33685f5d2fffed66ea997633f7806f98d29f0fe02e2ddc8ec"} Jun 07 16:34:55.776036 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:55.775794 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:34:55.805414 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:55.805374 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" podStartSLOduration=2.846455615 podStartE2EDuration="6.8053615s" totalImagesPullingTime="2.98557213s" totalInitContainerRuntime="973.333755ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:55.803312031 +0000 UTC m=+465.206660702" watchObservedRunningTime="2026-06-07 16:34:55.8053615 +0000 UTC m=+465.208710171" Jun 07 16:34:58.803159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:58.803123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:34:58.872624 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:34:58.872592 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:06.783600 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:06.783567 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-gtp66" Jun 07 16:35:08.591800 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:08.591765 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:08.850690 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:08.850584 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:09.689649 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.689605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:09.785572 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.785539 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc"] Jun 07 16:35:09.792240 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.792218 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.797104 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.797079 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 07 16:35:09.797220 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.797157 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 07 16:35:09.797274 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.797219 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p9bwv\"" Jun 07 16:35:09.797274 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.797219 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 07 16:35:09.809907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.809888 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc"] Jun 07 16:35:09.831964 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.831929 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:09.859508 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.859486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-manager-config\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.859629 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.859513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqgps\" (UniqueName: \"kubernetes.io/projected/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-kube-api-access-rqgps\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.859629 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.859559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-metrics-cert\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.859731 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.859687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-cert\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.937437 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.937406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:09.960948 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.960888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-cert\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.960948 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.960929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-manager-config\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.961072 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.960946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqgps\" (UniqueName: \"kubernetes.io/projected/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-kube-api-access-rqgps\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.961143 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.961125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-metrics-cert\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.961586 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.961560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-manager-config\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.963294 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.963277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-cert\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.963505 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.963489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-metrics-cert\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:09.970956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:09.970931 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqgps\" (UniqueName: \"kubernetes.io/projected/eb59d10b-0abd-4c4c-b8b3-cc387ce782a2-kube-api-access-rqgps\") pod \"lws-controller-manager-b9d9f97f8-4l9xc\" (UID: \"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:10.101674 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:10.101645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:10.211871 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:10.211805 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:10.250444 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:10.250424 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc"] Jun 07 16:35:10.251927 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:35:10.251900 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb59d10b_0abd_4c4c_b8b3_cc387ce782a2.slice/crio-47808060f76e178ba7f9e9c4c303ac0d76422a6df75541e50dc64b6615bc4cc1 WatchSource:0}: Error finding container 47808060f76e178ba7f9e9c4c303ac0d76422a6df75541e50dc64b6615bc4cc1: Status 404 returned error can't find the container with id 47808060f76e178ba7f9e9c4c303ac0d76422a6df75541e50dc64b6615bc4cc1 Jun 07 16:35:10.636975 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:10.636922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:10.850823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:10.850789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" event={"ID":"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2","Type":"ContainerStarted","Data":"47808060f76e178ba7f9e9c4c303ac0d76422a6df75541e50dc64b6615bc4cc1"} Jun 07 16:35:10.980788 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:10.980724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:12.863732 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:12.863691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" event={"ID":"eb59d10b-0abd-4c4c-b8b3-cc387ce782a2","Type":"ContainerStarted","Data":"c0a5326a202ea084b11f4aa6f24706bf40fddd023f057e09a48d07343c8a5015"} Jun 07 16:35:12.864102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:12.863779 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:12.881968 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:12.881920 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" podStartSLOduration=1.910145333 podStartE2EDuration="3.881906837s" totalImagesPullingTime="1.971761504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:12.88014487 +0000 UTC m=+482.283493552" watchObservedRunningTime="2026-06-07 16:35:12.881906837 +0000 UTC m=+482.285255508" Jun 07 16:35:14.770419 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.770388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:14.860192 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.860163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:14.863990 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.863967 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f"] Jun 07 16:35:14.866707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.866691 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:14.869400 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.869382 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:35:14.869555 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.869536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j8nkm\"" Jun 07 16:35:14.870415 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.870385 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:35:14.877718 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.877697 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f"] Jun 07 16:35:14.899999 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.899968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:14.900124 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.900010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwcwq\" (UniqueName: \"kubernetes.io/projected/4de2f91b-d751-4936-bfc3-622aad6fa585-kube-api-access-jwcwq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:14.900124 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:14.900038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.000561 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.000534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.000763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.000604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.000763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.000623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwcwq\" (UniqueName: \"kubernetes.io/projected/4de2f91b-d751-4936-bfc3-622aad6fa585-kube-api-access-jwcwq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.000946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.000926 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.001018 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.000978 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.008455 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.008436 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwcwq\" (UniqueName: \"kubernetes.io/projected/4de2f91b-d751-4936-bfc3-622aad6fa585-kube-api-access-jwcwq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.094994 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.094896 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:15.176133 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.176098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:15.307102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.307078 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f"] Jun 07 16:35:15.309164 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:35:15.309137 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de2f91b_d751_4936_bfc3_622aad6fa585.slice/crio-17830e59aec5c3e1918c83893ff2f5fa740bf3cb4c28d9ffcf81e4ad07266ab2 WatchSource:0}: Error finding container 17830e59aec5c3e1918c83893ff2f5fa740bf3cb4c28d9ffcf81e4ad07266ab2: Status 404 returned error can't find the container with id 17830e59aec5c3e1918c83893ff2f5fa740bf3cb4c28d9ffcf81e4ad07266ab2 Jun 07 16:35:15.882771 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.882739 2561 generic.go:356] "Generic (PLEG): container finished" podID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerID="0320f11987ffb584d6cf6c6e757c793ee635066b4c0bf26d4c7160ce3de7a6ad" exitCode=0 Jun 07 16:35:15.883173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.882789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" event={"ID":"4de2f91b-d751-4936-bfc3-622aad6fa585","Type":"ContainerDied","Data":"0320f11987ffb584d6cf6c6e757c793ee635066b4c0bf26d4c7160ce3de7a6ad"} Jun 07 16:35:15.883173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:15.882850 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" event={"ID":"4de2f91b-d751-4936-bfc3-622aad6fa585","Type":"ContainerStarted","Data":"17830e59aec5c3e1918c83893ff2f5fa740bf3cb4c28d9ffcf81e4ad07266ab2"} Jun 07 16:35:18.902956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:18.902919 2561 generic.go:356] "Generic (PLEG): container finished" podID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerID="4149f5f375a43a4ffd17244e546eafa1d46592b6b713e2b736a7cb031dc0d631" exitCode=0 Jun 07 16:35:18.903490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:18.902996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" event={"ID":"4de2f91b-d751-4936-bfc3-622aad6fa585","Type":"ContainerDied","Data":"4149f5f375a43a4ffd17244e546eafa1d46592b6b713e2b736a7cb031dc0d631"} Jun 07 16:35:19.910099 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:19.910065 2561 generic.go:356] "Generic (PLEG): container finished" podID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerID="4aceb66516ec6adb3c0a4b11696d05bb3b442409fa581f256eede14e83e73c6c" exitCode=0 Jun 07 16:35:19.910510 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:19.910137 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" event={"ID":"4de2f91b-d751-4936-bfc3-622aad6fa585","Type":"ContainerDied","Data":"4aceb66516ec6adb3c0a4b11696d05bb3b442409fa581f256eede14e83e73c6c"} Jun 07 16:35:20.758763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:20.758729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:20.909773 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:20.909744 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:21.044784 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.044760 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:21.151939 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.151911 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwcwq\" (UniqueName: \"kubernetes.io/projected/4de2f91b-d751-4936-bfc3-622aad6fa585-kube-api-access-jwcwq\") pod \"4de2f91b-d751-4936-bfc3-622aad6fa585\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " Jun 07 16:35:21.152075 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.151968 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-util\") pod \"4de2f91b-d751-4936-bfc3-622aad6fa585\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " Jun 07 16:35:21.152075 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.151996 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-bundle\") pod \"4de2f91b-d751-4936-bfc3-622aad6fa585\" (UID: \"4de2f91b-d751-4936-bfc3-622aad6fa585\") " Jun 07 16:35:21.152838 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.152812 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-bundle" (OuterVolumeSpecName: "bundle") pod "4de2f91b-d751-4936-bfc3-622aad6fa585" (UID: "4de2f91b-d751-4936-bfc3-622aad6fa585"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:35:21.154047 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.154025 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de2f91b-d751-4936-bfc3-622aad6fa585-kube-api-access-jwcwq" (OuterVolumeSpecName: "kube-api-access-jwcwq") pod "4de2f91b-d751-4936-bfc3-622aad6fa585" (UID: "4de2f91b-d751-4936-bfc3-622aad6fa585"). InnerVolumeSpecName "kube-api-access-jwcwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:35:21.156333 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.156313 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-util" (OuterVolumeSpecName: "util") pod "4de2f91b-d751-4936-bfc3-622aad6fa585" (UID: "4de2f91b-d751-4936-bfc3-622aad6fa585"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:35:21.188661 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.188617 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:21.253499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.253476 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwcwq\" (UniqueName: \"kubernetes.io/projected/4de2f91b-d751-4936-bfc3-622aad6fa585-kube-api-access-jwcwq\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:35:21.253499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.253496 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:35:21.253617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.253506 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4de2f91b-d751-4936-bfc3-622aad6fa585-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:35:21.306800 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.306718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:21.921813 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.921775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" event={"ID":"4de2f91b-d751-4936-bfc3-622aad6fa585","Type":"ContainerDied","Data":"17830e59aec5c3e1918c83893ff2f5fa740bf3cb4c28d9ffcf81e4ad07266ab2"} Jun 07 16:35:21.922001 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.921828 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17830e59aec5c3e1918c83893ff2f5fa740bf3cb4c28d9ffcf81e4ad07266ab2" Jun 07 16:35:21.922001 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:21.921788 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x4c6f" Jun 07 16:35:22.040970 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:22.040940 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:22.164212 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:22.164176 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:23.874133 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:23.874107 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-4l9xc" Jun 07 16:35:28.281716 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:28.281685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:28.543502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:28.543423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:29.952129 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952084 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx"] Jun 07 16:35:29.952502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952430 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="util" Jun 07 16:35:29.952502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952441 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="util" Jun 07 16:35:29.952502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952449 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="extract" Jun 07 16:35:29.952502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952454 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="extract" Jun 07 16:35:29.952502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952474 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="pull" Jun 07 16:35:29.952502 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952479 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="pull" Jun 07 16:35:29.952743 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.952533 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4de2f91b-d751-4936-bfc3-622aad6fa585" containerName="extract" Jun 07 16:35:29.955451 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.955436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:29.967778 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.967759 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j8nkm\"" Jun 07 16:35:29.968827 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.968814 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:35:29.972593 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:29.972581 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:35:30.009789 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.009766 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx"] Jun 07 16:35:30.023740 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.023717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6l68\" (UniqueName: \"kubernetes.io/projected/b1c83eb3-b298-4dc6-b984-95fa692a42f8-kube-api-access-z6l68\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.023836 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.023773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.023892 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.023849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.124436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.124407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.124565 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.124498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.124565 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.124531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6l68\" (UniqueName: \"kubernetes.io/projected/b1c83eb3-b298-4dc6-b984-95fa692a42f8-kube-api-access-z6l68\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.124866 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.124841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.124981 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.124961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.142062 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.142034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6l68\" (UniqueName: \"kubernetes.io/projected/b1c83eb3-b298-4dc6-b984-95fa692a42f8-kube-api-access-z6l68\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.263938 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.263908 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:30.509309 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.509276 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx"] Jun 07 16:35:30.535611 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:35:30.535583 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c83eb3_b298_4dc6_b984_95fa692a42f8.slice/crio-2be3badb27922d3c3b9cc2c16a2507a8526e65f6486bd507e26fa5e87857783c WatchSource:0}: Error finding container 2be3badb27922d3c3b9cc2c16a2507a8526e65f6486bd507e26fa5e87857783c: Status 404 returned error can't find the container with id 2be3badb27922d3c3b9cc2c16a2507a8526e65f6486bd507e26fa5e87857783c Jun 07 16:35:30.972926 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.972834 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerID="8c86d087986f64a088e92ce7e408f77bd71fa3335760e0866196e7d970bd83ac" exitCode=0 Jun 07 16:35:30.973273 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.972933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" event={"ID":"b1c83eb3-b298-4dc6-b984-95fa692a42f8","Type":"ContainerDied","Data":"8c86d087986f64a088e92ce7e408f77bd71fa3335760e0866196e7d970bd83ac"} Jun 07 16:35:30.973273 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:30.972982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" event={"ID":"b1c83eb3-b298-4dc6-b984-95fa692a42f8","Type":"ContainerStarted","Data":"2be3badb27922d3c3b9cc2c16a2507a8526e65f6486bd507e26fa5e87857783c"} Jun 07 16:35:31.228556 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:31.228489 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:31.455827 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:31.455792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:31.637703 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:31.637672 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:31.841717 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:31.841690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:31.979471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:31.979390 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerID="7eb6798a21e246ea4e8963a91c8d0195b1d996c13f3bf0208cf92fe8c72b0fd5" exitCode=0 Jun 07 16:35:31.979825 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:31.979470 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" event={"ID":"b1c83eb3-b298-4dc6-b984-95fa692a42f8","Type":"ContainerDied","Data":"7eb6798a21e246ea4e8963a91c8d0195b1d996c13f3bf0208cf92fe8c72b0fd5"} Jun 07 16:35:32.245038 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:32.245008 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:32.987066 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:32.987036 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerID="5a852104d58597c6cc2575d9ed580399240996df52f7fc0dcfbe08fc1ddb95aa" exitCode=0 Jun 07 16:35:32.987420 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:32.987095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" event={"ID":"b1c83eb3-b298-4dc6-b984-95fa692a42f8","Type":"ContainerDied","Data":"5a852104d58597c6cc2575d9ed580399240996df52f7fc0dcfbe08fc1ddb95aa"} Jun 07 16:35:33.016970 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.016943 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6578896ff8-qrwt6"] Jun 07 16:35:33.020348 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.020317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.026536 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.026514 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 16:35:33.026678 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.026602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n4vc2\"" Jun 07 16:35:33.044871 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.044847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6578896ff8-qrwt6"] Jun 07 16:35:33.149996 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.149968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fbe0dd1d-5418-4299-9c7f-3492e4213cee-redirect-config\") pod \"dashboard-redirect-6578896ff8-qrwt6\" (UID: \"fbe0dd1d-5418-4299-9c7f-3492e4213cee\") " pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.150181 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.150061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz5gf\" (UniqueName: \"kubernetes.io/projected/fbe0dd1d-5418-4299-9c7f-3492e4213cee-kube-api-access-tz5gf\") pod \"dashboard-redirect-6578896ff8-qrwt6\" (UID: \"fbe0dd1d-5418-4299-9c7f-3492e4213cee\") " pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.159789 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.159759 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:33.250397 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.250376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fbe0dd1d-5418-4299-9c7f-3492e4213cee-redirect-config\") pod \"dashboard-redirect-6578896ff8-qrwt6\" (UID: \"fbe0dd1d-5418-4299-9c7f-3492e4213cee\") " pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.250487 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.250421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz5gf\" (UniqueName: \"kubernetes.io/projected/fbe0dd1d-5418-4299-9c7f-3492e4213cee-kube-api-access-tz5gf\") pod \"dashboard-redirect-6578896ff8-qrwt6\" (UID: \"fbe0dd1d-5418-4299-9c7f-3492e4213cee\") " pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.251088 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.251072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fbe0dd1d-5418-4299-9c7f-3492e4213cee-redirect-config\") pod \"dashboard-redirect-6578896ff8-qrwt6\" (UID: \"fbe0dd1d-5418-4299-9c7f-3492e4213cee\") " pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.271851 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.271828 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz5gf\" (UniqueName: \"kubernetes.io/projected/fbe0dd1d-5418-4299-9c7f-3492e4213cee-kube-api-access-tz5gf\") pod \"dashboard-redirect-6578896ff8-qrwt6\" (UID: \"fbe0dd1d-5418-4299-9c7f-3492e4213cee\") " pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.331459 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.331435 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" Jun 07 16:35:33.527777 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.527645 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6578896ff8-qrwt6"] Jun 07 16:35:33.530445 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:35:33.530415 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe0dd1d_5418_4299_9c7f_3492e4213cee.slice/crio-ad25be36d023a1dbd57bcc41a3d183a203c6a1b3a5da3d648472c1343562a8d9 WatchSource:0}: Error finding container ad25be36d023a1dbd57bcc41a3d183a203c6a1b3a5da3d648472c1343562a8d9: Status 404 returned error can't find the container with id ad25be36d023a1dbd57bcc41a3d183a203c6a1b3a5da3d648472c1343562a8d9 Jun 07 16:35:33.634957 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.634928 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:33.993551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:33.993522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" event={"ID":"fbe0dd1d-5418-4299-9c7f-3492e4213cee","Type":"ContainerStarted","Data":"ad25be36d023a1dbd57bcc41a3d183a203c6a1b3a5da3d648472c1343562a8d9"} Jun 07 16:35:34.124145 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.124123 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:34.258982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.258903 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-util\") pod \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " Jun 07 16:35:34.258982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.258932 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-bundle\") pod \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " Jun 07 16:35:34.259196 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.259023 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6l68\" (UniqueName: \"kubernetes.io/projected/b1c83eb3-b298-4dc6-b984-95fa692a42f8-kube-api-access-z6l68\") pod \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\" (UID: \"b1c83eb3-b298-4dc6-b984-95fa692a42f8\") " Jun 07 16:35:34.259794 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.259770 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-bundle" (OuterVolumeSpecName: "bundle") pod "b1c83eb3-b298-4dc6-b984-95fa692a42f8" (UID: "b1c83eb3-b298-4dc6-b984-95fa692a42f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:35:34.261114 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.261092 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c83eb3-b298-4dc6-b984-95fa692a42f8-kube-api-access-z6l68" (OuterVolumeSpecName: "kube-api-access-z6l68") pod "b1c83eb3-b298-4dc6-b984-95fa692a42f8" (UID: "b1c83eb3-b298-4dc6-b984-95fa692a42f8"). InnerVolumeSpecName "kube-api-access-z6l68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:35:34.264329 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.264306 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-util" (OuterVolumeSpecName: "util") pod "b1c83eb3-b298-4dc6-b984-95fa692a42f8" (UID: "b1c83eb3-b298-4dc6-b984-95fa692a42f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:35:34.359852 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.359830 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:35:34.359852 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.359852 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c83eb3-b298-4dc6-b984-95fa692a42f8-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:35:34.359973 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.359861 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6l68\" (UniqueName: \"kubernetes.io/projected/b1c83eb3-b298-4dc6-b984-95fa692a42f8-kube-api-access-z6l68\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:35:34.384728 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.384698 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:34.577794 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:34.577710 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:35.008402 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:35.008379 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" Jun 07 16:35:35.008789 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:35.008416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aksmzx" event={"ID":"b1c83eb3-b298-4dc6-b984-95fa692a42f8","Type":"ContainerDied","Data":"2be3badb27922d3c3b9cc2c16a2507a8526e65f6486bd507e26fa5e87857783c"} Jun 07 16:35:35.008789 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:35.008490 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2be3badb27922d3c3b9cc2c16a2507a8526e65f6486bd507e26fa5e87857783c" Jun 07 16:35:36.015139 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:36.015100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" event={"ID":"fbe0dd1d-5418-4299-9c7f-3492e4213cee","Type":"ContainerStarted","Data":"e1f3124c266a9ae6fe359f619e21f6646054be6c3b244f77b59129203903fbde"} Jun 07 16:35:36.046131 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:36.046080 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6578896ff8-qrwt6" podStartSLOduration=2.064208318 podStartE2EDuration="4.046065945s" totalImagesPullingTime="1.981857627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:36.044339852 +0000 UTC m=+505.447688523" watchObservedRunningTime="2026-06-07 16:35:36.046065945 +0000 UTC m=+505.449414614" Jun 07 16:35:42.523807 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:42.523772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:42.618351 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:42.618314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:43.939529 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:43.939501 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:44.038315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:44.038281 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:44.587217 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:44.587178 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:48.371374 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.371343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:48.430115 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.430087 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:48.691561 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691491 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z"] Jun 07 16:35:48.691911 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691897 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="util" Jun 07 16:35:48.691956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691913 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="util" Jun 07 16:35:48.691956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691934 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="pull" Jun 07 16:35:48.691956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691939 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="pull" Jun 07 16:35:48.691956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691946 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="extract" Jun 07 16:35:48.691956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.691951 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="extract" Jun 07 16:35:48.692095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.692005 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c83eb3-b298-4dc6-b984-95fa692a42f8" containerName="extract" Jun 07 16:35:48.697861 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.697845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.700627 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.700605 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 16:35:48.700772 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.700745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-q2hsb\"" Jun 07 16:35:48.700879 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.700865 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 16:35:48.704361 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.704219 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 16:35:48.712443 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.712404 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z"] Jun 07 16:35:48.727187 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.727160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:48.870284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npbhp\" (UniqueName: \"kubernetes.io/projected/35d76161-769b-45fd-b122-dbff834d4c79-kube-api-access-npbhp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d76161-769b-45fd-b122-dbff834d4c79-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d76161-769b-45fd-b122-dbff834d4c79-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d76161-769b-45fd-b122-dbff834d4c79-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.870720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.870600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.897358 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.897314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:48.971375 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971375 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d76161-769b-45fd-b122-dbff834d4c79-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971375 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npbhp\" (UniqueName: \"kubernetes.io/projected/35d76161-769b-45fd-b122-dbff834d4c79-kube-api-access-npbhp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971837 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d76161-769b-45fd-b122-dbff834d4c79-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971837 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d76161-769b-45fd-b122-dbff834d4c79-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971837 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971962 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971863 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.971962 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.971942 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.972428 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.972407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d76161-769b-45fd-b122-dbff834d4c79-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.972659 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.972610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.973900 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.973875 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d76161-769b-45fd-b122-dbff834d4c79-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.974784 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.974765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d76161-769b-45fd-b122-dbff834d4c79-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.979681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.979655 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d76161-769b-45fd-b122-dbff834d4c79-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.979884 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.979863 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npbhp\" (UniqueName: \"kubernetes.io/projected/35d76161-769b-45fd-b122-dbff834d4c79-kube-api-access-npbhp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fcb7z\" (UID: \"35d76161-769b-45fd-b122-dbff834d4c79\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:48.999541 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:48.999520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:49.007601 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:49.007581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:49.144841 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:49.144817 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z"] Jun 07 16:35:49.146662 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:35:49.146613 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d76161_769b_45fd_b122_dbff834d4c79.slice/crio-cb2832fa9ad09d138e9b55bfe0f4221a52a6e903a623dcb016669b93084ac756 WatchSource:0}: Error finding container cb2832fa9ad09d138e9b55bfe0f4221a52a6e903a623dcb016669b93084ac756: Status 404 returned error can't find the container with id cb2832fa9ad09d138e9b55bfe0f4221a52a6e903a623dcb016669b93084ac756 Jun 07 16:35:49.512037 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:49.512004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:35:50.097070 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:50.097037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" event={"ID":"35d76161-769b-45fd-b122-dbff834d4c79","Type":"ContainerStarted","Data":"cb2832fa9ad09d138e9b55bfe0f4221a52a6e903a623dcb016669b93084ac756"} Jun 07 16:35:51.988496 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:51.988449 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 07 16:35:51.988831 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:51.988516 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 07 16:35:51.988831 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:51.988546 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 07 16:35:52.115585 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:52.115537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" event={"ID":"35d76161-769b-45fd-b122-dbff834d4c79","Type":"ContainerStarted","Data":"74f7c7b56d25be65f71f6a56491642b5fc4036552ff53857ad480cfdeb2d6562"} Jun 07 16:35:52.141628 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:52.141562 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" podStartSLOduration=1.301993307 podStartE2EDuration="4.141544554s" totalImagesPullingTime="2.839551247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:52.140844139 +0000 UTC m=+521.544192814" watchObservedRunningTime="2026-06-07 16:35:52.141544554 +0000 UTC m=+521.544893224" Jun 07 16:35:53.008790 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:53.008760 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:53.013395 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:53.013375 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:53.120980 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:53.120953 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:35:53.121756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:35:53.121739 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fcb7z" Jun 07 16:36:10.343085 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.342996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:10.436747 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.436715 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:10.460984 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.460957 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8zlt"] Jun 07 16:36:10.472864 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.472844 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:10.476322 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.476302 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4jwfg\"" Jun 07 16:36:10.477974 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.477960 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:36:10.484000 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.483980 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:36:10.491211 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.491188 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8zlt"] Jun 07 16:36:10.553573 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.553544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl9wj\" (UniqueName: \"kubernetes.io/projected/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05-kube-api-access-sl9wj\") pod \"kuadrant-operator-catalog-l8zlt\" (UID: \"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05\") " pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:10.579681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.579659 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:10.655049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.654970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl9wj\" (UniqueName: \"kubernetes.io/projected/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05-kube-api-access-sl9wj\") pod \"kuadrant-operator-catalog-l8zlt\" (UID: \"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05\") " pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:10.662998 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.662971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl9wj\" (UniqueName: \"kubernetes.io/projected/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05-kube-api-access-sl9wj\") pod \"kuadrant-operator-catalog-l8zlt\" (UID: \"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05\") " pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:10.782174 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.782135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:10.835621 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.835591 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8zlt"] Jun 07 16:36:10.916334 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:10.916306 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8zlt"] Jun 07 16:36:10.918246 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:10.918224 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd7a9cb_bbfc_4244_9dd0_4113db9f8b05.slice/crio-764f0c27f18a9cdc9a3420616962029296786f99018ab2dd3889a7668510ec4a WatchSource:0}: Error finding container 764f0c27f18a9cdc9a3420616962029296786f99018ab2dd3889a7668510ec4a: Status 404 returned error can't find the container with id 764f0c27f18a9cdc9a3420616962029296786f99018ab2dd3889a7668510ec4a Jun 07 16:36:11.045298 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.045256 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ksp6j"] Jun 07 16:36:11.050169 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.050150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:11.055731 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.055707 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ksp6j"] Jun 07 16:36:11.159411 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.159382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hlq\" (UniqueName: \"kubernetes.io/projected/9547a9a6-4682-41de-a1d0-ef5015992a5b-kube-api-access-54hlq\") pod \"kuadrant-operator-catalog-ksp6j\" (UID: \"9547a9a6-4682-41de-a1d0-ef5015992a5b\") " pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:11.211665 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.211563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" event={"ID":"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05","Type":"ContainerStarted","Data":"764f0c27f18a9cdc9a3420616962029296786f99018ab2dd3889a7668510ec4a"} Jun 07 16:36:11.260821 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.260790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hlq\" (UniqueName: \"kubernetes.io/projected/9547a9a6-4682-41de-a1d0-ef5015992a5b-kube-api-access-54hlq\") pod \"kuadrant-operator-catalog-ksp6j\" (UID: \"9547a9a6-4682-41de-a1d0-ef5015992a5b\") " pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:11.269392 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.269367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hlq\" (UniqueName: \"kubernetes.io/projected/9547a9a6-4682-41de-a1d0-ef5015992a5b-kube-api-access-54hlq\") pod \"kuadrant-operator-catalog-ksp6j\" (UID: \"9547a9a6-4682-41de-a1d0-ef5015992a5b\") " pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:11.271095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.271038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:11.360842 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.360815 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:11.467845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.467747 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:11.507228 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:11.507187 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ksp6j"] Jun 07 16:36:11.587119 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:11.587078 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9547a9a6_4682_41de_a1d0_ef5015992a5b.slice/crio-bfd06406b028b24b197bd7f6b8bb032e86d7daeaf72dd5f5acb55c296067f604 WatchSource:0}: Error finding container bfd06406b028b24b197bd7f6b8bb032e86d7daeaf72dd5f5acb55c296067f604: Status 404 returned error can't find the container with id bfd06406b028b24b197bd7f6b8bb032e86d7daeaf72dd5f5acb55c296067f604 Jun 07 16:36:12.220569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:12.220508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" event={"ID":"9547a9a6-4682-41de-a1d0-ef5015992a5b","Type":"ContainerStarted","Data":"bfd06406b028b24b197bd7f6b8bb032e86d7daeaf72dd5f5acb55c296067f604"} Jun 07 16:36:13.227474 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.227381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" event={"ID":"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05","Type":"ContainerStarted","Data":"227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14"} Jun 07 16:36:13.227929 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.227459 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" podUID="ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" containerName="registry-server" containerID="cri-o://227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14" gracePeriod=2 Jun 07 16:36:13.229326 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.229273 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" event={"ID":"9547a9a6-4682-41de-a1d0-ef5015992a5b","Type":"ContainerStarted","Data":"6c44f92e8a75b804114b7b6153184c2c09096bcabb6e59f0f5e0b3fc2df8b505"} Jun 07 16:36:13.242666 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.242603 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" podStartSLOduration=1.195588023 podStartE2EDuration="3.242588617s" totalImagesPullingTime="2.047000594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:36:13.241386821 +0000 UTC m=+542.644735492" watchObservedRunningTime="2026-06-07 16:36:13.242588617 +0000 UTC m=+542.645937286" Jun 07 16:36:13.259499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.259330 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" podStartSLOduration=0.878159393 podStartE2EDuration="2.259309681s" totalImagesPullingTime="1.381150288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:36:13.258906169 +0000 UTC m=+542.662254840" watchObservedRunningTime="2026-06-07 16:36:13.259309681 +0000 UTC m=+542.662658354" Jun 07 16:36:13.472327 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.472300 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:13.582952 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.582922 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl9wj\" (UniqueName: \"kubernetes.io/projected/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05-kube-api-access-sl9wj\") pod \"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05\" (UID: \"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05\") " Jun 07 16:36:13.585207 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.585174 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05-kube-api-access-sl9wj" (OuterVolumeSpecName: "kube-api-access-sl9wj") pod "ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" (UID: "ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05"). InnerVolumeSpecName "kube-api-access-sl9wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:36:13.683508 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:13.683478 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl9wj\" (UniqueName: \"kubernetes.io/projected/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05-kube-api-access-sl9wj\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:14.235979 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.235944 2561 generic.go:356] "Generic (PLEG): container finished" podID="ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" containerID="227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14" exitCode=0 Jun 07 16:36:14.236403 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.235996 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" Jun 07 16:36:14.236403 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.236035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" event={"ID":"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05","Type":"ContainerDied","Data":"227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14"} Jun 07 16:36:14.236403 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.236081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8zlt" event={"ID":"ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05","Type":"ContainerDied","Data":"764f0c27f18a9cdc9a3420616962029296786f99018ab2dd3889a7668510ec4a"} Jun 07 16:36:14.236403 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.236106 2561 scope.go:117] "RemoveContainer" containerID="227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14" Jun 07 16:36:14.245757 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.245742 2561 scope.go:117] "RemoveContainer" containerID="227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14" Jun 07 16:36:14.246007 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:36:14.245991 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14\": container with ID starting with 227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14 not found: ID does not exist" containerID="227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14" Jun 07 16:36:14.246052 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.246015 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14"} err="failed to get container status \"227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14\": rpc error: code = NotFound desc = could not find container \"227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14\": container with ID starting with 227c52160c0326bdece2e1ec4823c30dba93630199803022fd043ca8a6449e14 not found: ID does not exist" Jun 07 16:36:14.257566 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.256482 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8zlt"] Jun 07 16:36:14.264833 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.264811 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8zlt"] Jun 07 16:36:14.994812 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:14.994783 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" path="/var/lib/kubelet/pods/ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05/volumes" Jun 07 16:36:21.361188 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:21.361157 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:21.361619 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:21.361213 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:21.383801 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:21.383770 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:22.296975 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:22.296942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ksp6j" Jun 07 16:36:26.283540 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.283505 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4"] Jun 07 16:36:26.284044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.283911 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" containerName="registry-server" Jun 07 16:36:26.284044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.283922 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" containerName="registry-server" Jun 07 16:36:26.284044 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.283986 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd7a9cb-bbfc-4244-9dd0-4113db9f8b05" containerName="registry-server" Jun 07 16:36:26.294374 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.294351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.294853 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.294818 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4"] Jun 07 16:36:26.296977 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.296953 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qg4pn\"" Jun 07 16:36:26.393181 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.393145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf9lg\" (UniqueName: \"kubernetes.io/projected/53ddaf8b-469b-464b-b184-ffaf4e677183-kube-api-access-bf9lg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.393354 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.393212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.393354 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.393242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.494428 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.494397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf9lg\" (UniqueName: \"kubernetes.io/projected/53ddaf8b-469b-464b-b184-ffaf4e677183-kube-api-access-bf9lg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.494610 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.494464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.494610 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.494492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.494878 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.494861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.494925 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.494896 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.503306 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.503286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf9lg\" (UniqueName: \"kubernetes.io/projected/53ddaf8b-469b-464b-b184-ffaf4e677183-kube-api-access-bf9lg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.606493 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.606417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:26.747378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:26.747352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4"] Jun 07 16:36:26.748952 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:26.748927 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ddaf8b_469b_464b_b184_ffaf4e677183.slice/crio-9b1ff9348a31a404c991c0c160e1c4756c934b050e944e18b69df0931b0fdad3 WatchSource:0}: Error finding container 9b1ff9348a31a404c991c0c160e1c4756c934b050e944e18b69df0931b0fdad3: Status 404 returned error can't find the container with id 9b1ff9348a31a404c991c0c160e1c4756c934b050e944e18b69df0931b0fdad3 Jun 07 16:36:27.073571 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.073542 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4"] Jun 07 16:36:27.077348 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.077332 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.084320 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.084165 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4"] Jun 07 16:36:27.199484 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.199452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.199600 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.199500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.199600 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.199564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzcz\" (UniqueName: \"kubernetes.io/projected/4ae47d64-00a9-448f-adf6-e49473cf65a2-kube-api-access-8rzcz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.299978 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.299950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzcz\" (UniqueName: \"kubernetes.io/projected/4ae47d64-00a9-448f-adf6-e49473cf65a2-kube-api-access-8rzcz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.300378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.300023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.300378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.300079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.300496 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.300459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.300538 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.300490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.303681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.303625 2561 generic.go:356] "Generic (PLEG): container finished" podID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerID="ff8f8be428f0dfea8421c06e57b1c45cab287bd8ef8a68fe10ce4bcdcdb2bf12" exitCode=0 Jun 07 16:36:27.303681 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.303664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" event={"ID":"53ddaf8b-469b-464b-b184-ffaf4e677183","Type":"ContainerDied","Data":"ff8f8be428f0dfea8421c06e57b1c45cab287bd8ef8a68fe10ce4bcdcdb2bf12"} Jun 07 16:36:27.303832 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.303710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" event={"ID":"53ddaf8b-469b-464b-b184-ffaf4e677183","Type":"ContainerStarted","Data":"9b1ff9348a31a404c991c0c160e1c4756c934b050e944e18b69df0931b0fdad3"} Jun 07 16:36:27.312396 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.312379 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzcz\" (UniqueName: \"kubernetes.io/projected/4ae47d64-00a9-448f-adf6-e49473cf65a2-kube-api-access-8rzcz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.387171 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.387100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:27.478883 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.478854 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57"] Jun 07 16:36:27.484175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.484151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.495058 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.495033 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57"] Jun 07 16:36:27.521961 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.521934 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4"] Jun 07 16:36:27.523475 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:27.523455 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae47d64_00a9_448f_adf6_e49473cf65a2.slice/crio-2349df6e845752207be19c2d03e90f3dbc0d69c07bfc5ffcc4d3019629fedf6b WatchSource:0}: Error finding container 2349df6e845752207be19c2d03e90f3dbc0d69c07bfc5ffcc4d3019629fedf6b: Status 404 returned error can't find the container with id 2349df6e845752207be19c2d03e90f3dbc0d69c07bfc5ffcc4d3019629fedf6b Jun 07 16:36:27.603283 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.603249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.603438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.603320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.603438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.603383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmczk\" (UniqueName: \"kubernetes.io/projected/265fba23-09d8-4486-b119-8647fb0b72a6-kube-api-access-cmczk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.703990 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.703935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmczk\" (UniqueName: \"kubernetes.io/projected/265fba23-09d8-4486-b119-8647fb0b72a6-kube-api-access-cmczk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.703990 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.703976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.704112 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.704043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.704336 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.704316 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.704374 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.704355 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.716947 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.716929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmczk\" (UniqueName: \"kubernetes.io/projected/265fba23-09d8-4486-b119-8647fb0b72a6-kube-api-access-cmczk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.796715 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.796689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:27.880754 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.880725 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk"] Jun 07 16:36:27.884443 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.884423 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:27.892106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.892083 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk"] Jun 07 16:36:27.943514 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:27.943486 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57"] Jun 07 16:36:27.949497 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:27.949470 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265fba23_09d8_4486_b119_8647fb0b72a6.slice/crio-9047f52d90defa75f2fd65d499f1184f1eca3548f7bb2c1d0950c5bb9038f06b WatchSource:0}: Error finding container 9047f52d90defa75f2fd65d499f1184f1eca3548f7bb2c1d0950c5bb9038f06b: Status 404 returned error can't find the container with id 9047f52d90defa75f2fd65d499f1184f1eca3548f7bb2c1d0950c5bb9038f06b Jun 07 16:36:28.007405 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.007382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcd5d\" (UniqueName: \"kubernetes.io/projected/f0044289-abd1-41ea-83ae-3c2b9a973cbf-kube-api-access-pcd5d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.007500 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.007419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.007500 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.007487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.108886 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.108860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcd5d\" (UniqueName: \"kubernetes.io/projected/f0044289-abd1-41ea-83ae-3c2b9a973cbf-kube-api-access-pcd5d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.109008 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.108915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.109008 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.108980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.109321 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.109294 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.109398 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.109300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.117355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.117333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcd5d\" (UniqueName: \"kubernetes.io/projected/f0044289-abd1-41ea-83ae-3c2b9a973cbf-kube-api-access-pcd5d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.197103 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.197069 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:28.310882 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.310854 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerID="f76dbfc783c8b806418130d92c7727a291d35f72f7db31e4e291bb6ce5440f4d" exitCode=0 Jun 07 16:36:28.311279 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.310941 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" event={"ID":"4ae47d64-00a9-448f-adf6-e49473cf65a2","Type":"ContainerDied","Data":"f76dbfc783c8b806418130d92c7727a291d35f72f7db31e4e291bb6ce5440f4d"} Jun 07 16:36:28.311279 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.310988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" event={"ID":"4ae47d64-00a9-448f-adf6-e49473cf65a2","Type":"ContainerStarted","Data":"2349df6e845752207be19c2d03e90f3dbc0d69c07bfc5ffcc4d3019629fedf6b"} Jun 07 16:36:28.312742 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.312713 2561 generic.go:356] "Generic (PLEG): container finished" podID="265fba23-09d8-4486-b119-8647fb0b72a6" containerID="7b277d1997d045aa75f826506e8d53f90f723d74fcc1f3cd83d937d629a8b840" exitCode=0 Jun 07 16:36:28.312868 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.312791 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" event={"ID":"265fba23-09d8-4486-b119-8647fb0b72a6","Type":"ContainerDied","Data":"7b277d1997d045aa75f826506e8d53f90f723d74fcc1f3cd83d937d629a8b840"} Jun 07 16:36:28.312868 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.312834 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" event={"ID":"265fba23-09d8-4486-b119-8647fb0b72a6","Type":"ContainerStarted","Data":"9047f52d90defa75f2fd65d499f1184f1eca3548f7bb2c1d0950c5bb9038f06b"} Jun 07 16:36:28.314912 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.314837 2561 generic.go:356] "Generic (PLEG): container finished" podID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerID="a3f67c415d64310e2e420b708dab064ff48fe6690f88fbf9b71c3359a3167577" exitCode=0 Jun 07 16:36:28.314912 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.314904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" event={"ID":"53ddaf8b-469b-464b-b184-ffaf4e677183","Type":"ContainerDied","Data":"a3f67c415d64310e2e420b708dab064ff48fe6690f88fbf9b71c3359a3167577"} Jun 07 16:36:28.323175 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:28.323132 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk"] Jun 07 16:36:28.327989 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:28.327953 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0044289_abd1_41ea_83ae_3c2b9a973cbf.slice/crio-60fe96ace351007cce6dacb97b6f6b93b86a73d271984b77fa425ace4f5b0031 WatchSource:0}: Error finding container 60fe96ace351007cce6dacb97b6f6b93b86a73d271984b77fa425ace4f5b0031: Status 404 returned error can't find the container with id 60fe96ace351007cce6dacb97b6f6b93b86a73d271984b77fa425ace4f5b0031 Jun 07 16:36:29.322342 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.322309 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerID="7cc29d2ede97511153a5cc6133b764cef77fed6dba20e7cb3d1e7db213baaf8b" exitCode=0 Jun 07 16:36:29.322712 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.322393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" event={"ID":"4ae47d64-00a9-448f-adf6-e49473cf65a2","Type":"ContainerDied","Data":"7cc29d2ede97511153a5cc6133b764cef77fed6dba20e7cb3d1e7db213baaf8b"} Jun 07 16:36:29.324134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.324100 2561 generic.go:356] "Generic (PLEG): container finished" podID="265fba23-09d8-4486-b119-8647fb0b72a6" containerID="471618e2d95fbf8a9a3bda5e19c3b640d1dd4fde4f4175336b8bb4c4a1df53d9" exitCode=0 Jun 07 16:36:29.324229 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.324158 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" event={"ID":"265fba23-09d8-4486-b119-8647fb0b72a6","Type":"ContainerDied","Data":"471618e2d95fbf8a9a3bda5e19c3b640d1dd4fde4f4175336b8bb4c4a1df53d9"} Jun 07 16:36:29.325831 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.325787 2561 generic.go:356] "Generic (PLEG): container finished" podID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerID="8ddfe6b0fc180cc885fbb22581f83394ec8803ab2f13b16248b1a9316b20a86c" exitCode=0 Jun 07 16:36:29.325912 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.325854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" event={"ID":"f0044289-abd1-41ea-83ae-3c2b9a973cbf","Type":"ContainerDied","Data":"8ddfe6b0fc180cc885fbb22581f83394ec8803ab2f13b16248b1a9316b20a86c"} Jun 07 16:36:29.325912 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.325883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" event={"ID":"f0044289-abd1-41ea-83ae-3c2b9a973cbf","Type":"ContainerStarted","Data":"60fe96ace351007cce6dacb97b6f6b93b86a73d271984b77fa425ace4f5b0031"} Jun 07 16:36:29.328137 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.328115 2561 generic.go:356] "Generic (PLEG): container finished" podID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerID="5c4c696594eb74cc4b7ee4f1b048a3d168278b8c2d107a3a7f4692dda324375c" exitCode=0 Jun 07 16:36:29.328208 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:29.328156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" event={"ID":"53ddaf8b-469b-464b-b184-ffaf4e677183","Type":"ContainerDied","Data":"5c4c696594eb74cc4b7ee4f1b048a3d168278b8c2d107a3a7f4692dda324375c"} Jun 07 16:36:30.335495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.335464 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerID="3ba9173bcdd35bad247d778819e383fa0f34eb08d3de69146cc212a65f205ca9" exitCode=0 Jun 07 16:36:30.335904 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.335549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" event={"ID":"4ae47d64-00a9-448f-adf6-e49473cf65a2","Type":"ContainerDied","Data":"3ba9173bcdd35bad247d778819e383fa0f34eb08d3de69146cc212a65f205ca9"} Jun 07 16:36:30.337537 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.337517 2561 generic.go:356] "Generic (PLEG): container finished" podID="265fba23-09d8-4486-b119-8647fb0b72a6" containerID="fe01999392050c3e0141301013d62abab0926483d1938d30197dc85880333cbc" exitCode=0 Jun 07 16:36:30.337628 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.337598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" event={"ID":"265fba23-09d8-4486-b119-8647fb0b72a6","Type":"ContainerDied","Data":"fe01999392050c3e0141301013d62abab0926483d1938d30197dc85880333cbc"} Jun 07 16:36:30.339464 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.339441 2561 generic.go:356] "Generic (PLEG): container finished" podID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerID="d8c767b5b470186f153ba70e8591674625b1eec5740e8ba85a01c749766cdbd8" exitCode=0 Jun 07 16:36:30.339563 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.339521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" event={"ID":"f0044289-abd1-41ea-83ae-3c2b9a973cbf","Type":"ContainerDied","Data":"d8c767b5b470186f153ba70e8591674625b1eec5740e8ba85a01c749766cdbd8"} Jun 07 16:36:30.475063 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.475039 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:30.633154 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.633097 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-util\") pod \"53ddaf8b-469b-464b-b184-ffaf4e677183\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " Jun 07 16:36:30.633252 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.633165 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf9lg\" (UniqueName: \"kubernetes.io/projected/53ddaf8b-469b-464b-b184-ffaf4e677183-kube-api-access-bf9lg\") pod \"53ddaf8b-469b-464b-b184-ffaf4e677183\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " Jun 07 16:36:30.633252 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.633217 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-bundle\") pod \"53ddaf8b-469b-464b-b184-ffaf4e677183\" (UID: \"53ddaf8b-469b-464b-b184-ffaf4e677183\") " Jun 07 16:36:30.633908 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.633868 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-bundle" (OuterVolumeSpecName: "bundle") pod "53ddaf8b-469b-464b-b184-ffaf4e677183" (UID: "53ddaf8b-469b-464b-b184-ffaf4e677183"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:30.635199 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.635177 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ddaf8b-469b-464b-b184-ffaf4e677183-kube-api-access-bf9lg" (OuterVolumeSpecName: "kube-api-access-bf9lg") pod "53ddaf8b-469b-464b-b184-ffaf4e677183" (UID: "53ddaf8b-469b-464b-b184-ffaf4e677183"). InnerVolumeSpecName "kube-api-access-bf9lg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:36:30.638558 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.638538 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-util" (OuterVolumeSpecName: "util") pod "53ddaf8b-469b-464b-b184-ffaf4e677183" (UID: "53ddaf8b-469b-464b-b184-ffaf4e677183"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:30.734721 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.734690 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:30.734721 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.734719 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ddaf8b-469b-464b-b184-ffaf4e677183-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:30.734721 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:30.734728 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf9lg\" (UniqueName: \"kubernetes.io/projected/53ddaf8b-469b-464b-b184-ffaf4e677183-kube-api-access-bf9lg\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:31.346102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.346006 2561 generic.go:356] "Generic (PLEG): container finished" podID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerID="d49b972601005cf2b6a7956af15ff43d68049170e9a252609ba56f037edb2456" exitCode=0 Jun 07 16:36:31.346102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.346089 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" event={"ID":"f0044289-abd1-41ea-83ae-3c2b9a973cbf","Type":"ContainerDied","Data":"d49b972601005cf2b6a7956af15ff43d68049170e9a252609ba56f037edb2456"} Jun 07 16:36:31.347789 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.347765 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" Jun 07 16:36:31.347909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.347792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4" event={"ID":"53ddaf8b-469b-464b-b184-ffaf4e677183","Type":"ContainerDied","Data":"9b1ff9348a31a404c991c0c160e1c4756c934b050e944e18b69df0931b0fdad3"} Jun 07 16:36:31.347909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.347827 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b1ff9348a31a404c991c0c160e1c4756c934b050e944e18b69df0931b0fdad3" Jun 07 16:36:31.477560 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.477538 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:31.501454 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.501433 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:31.541069 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.541043 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-bundle\") pod \"4ae47d64-00a9-448f-adf6-e49473cf65a2\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " Jun 07 16:36:31.541190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.541091 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rzcz\" (UniqueName: \"kubernetes.io/projected/4ae47d64-00a9-448f-adf6-e49473cf65a2-kube-api-access-8rzcz\") pod \"4ae47d64-00a9-448f-adf6-e49473cf65a2\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " Jun 07 16:36:31.541190 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.541130 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-util\") pod \"4ae47d64-00a9-448f-adf6-e49473cf65a2\" (UID: \"4ae47d64-00a9-448f-adf6-e49473cf65a2\") " Jun 07 16:36:31.541654 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.541607 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-bundle" (OuterVolumeSpecName: "bundle") pod "4ae47d64-00a9-448f-adf6-e49473cf65a2" (UID: "4ae47d64-00a9-448f-adf6-e49473cf65a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:31.543344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.543317 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae47d64-00a9-448f-adf6-e49473cf65a2-kube-api-access-8rzcz" (OuterVolumeSpecName: "kube-api-access-8rzcz") pod "4ae47d64-00a9-448f-adf6-e49473cf65a2" (UID: "4ae47d64-00a9-448f-adf6-e49473cf65a2"). InnerVolumeSpecName "kube-api-access-8rzcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:36:31.546864 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.546833 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-util" (OuterVolumeSpecName: "util") pod "4ae47d64-00a9-448f-adf6-e49473cf65a2" (UID: "4ae47d64-00a9-448f-adf6-e49473cf65a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:31.641873 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.641809 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-util\") pod \"265fba23-09d8-4486-b119-8647fb0b72a6\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " Jun 07 16:36:31.642010 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.641908 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-bundle\") pod \"265fba23-09d8-4486-b119-8647fb0b72a6\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " Jun 07 16:36:31.642010 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.641925 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmczk\" (UniqueName: \"kubernetes.io/projected/265fba23-09d8-4486-b119-8647fb0b72a6-kube-api-access-cmczk\") pod \"265fba23-09d8-4486-b119-8647fb0b72a6\" (UID: \"265fba23-09d8-4486-b119-8647fb0b72a6\") " Jun 07 16:36:31.642125 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.642071 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:31.642125 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.642081 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rzcz\" (UniqueName: \"kubernetes.io/projected/4ae47d64-00a9-448f-adf6-e49473cf65a2-kube-api-access-8rzcz\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:31.642125 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.642092 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47d64-00a9-448f-adf6-e49473cf65a2-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:31.642317 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.642294 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-bundle" (OuterVolumeSpecName: "bundle") pod "265fba23-09d8-4486-b119-8647fb0b72a6" (UID: "265fba23-09d8-4486-b119-8647fb0b72a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:31.644059 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.644038 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/265fba23-09d8-4486-b119-8647fb0b72a6-kube-api-access-cmczk" (OuterVolumeSpecName: "kube-api-access-cmczk") pod "265fba23-09d8-4486-b119-8647fb0b72a6" (UID: "265fba23-09d8-4486-b119-8647fb0b72a6"). InnerVolumeSpecName "kube-api-access-cmczk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:36:31.646493 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.646470 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-util" (OuterVolumeSpecName: "util") pod "265fba23-09d8-4486-b119-8647fb0b72a6" (UID: "265fba23-09d8-4486-b119-8647fb0b72a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:31.742588 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.742557 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:31.742588 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.742584 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/265fba23-09d8-4486-b119-8647fb0b72a6-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:31.742756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:31.742595 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmczk\" (UniqueName: \"kubernetes.io/projected/265fba23-09d8-4486-b119-8647fb0b72a6-kube-api-access-cmczk\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:32.355008 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.354983 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" Jun 07 16:36:32.355008 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.354990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4" event={"ID":"4ae47d64-00a9-448f-adf6-e49473cf65a2","Type":"ContainerDied","Data":"2349df6e845752207be19c2d03e90f3dbc0d69c07bfc5ffcc4d3019629fedf6b"} Jun 07 16:36:32.355409 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.355035 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2349df6e845752207be19c2d03e90f3dbc0d69c07bfc5ffcc4d3019629fedf6b" Jun 07 16:36:32.356994 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.356971 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" Jun 07 16:36:32.357095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.357017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57" event={"ID":"265fba23-09d8-4486-b119-8647fb0b72a6","Type":"ContainerDied","Data":"9047f52d90defa75f2fd65d499f1184f1eca3548f7bb2c1d0950c5bb9038f06b"} Jun 07 16:36:32.357095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.357054 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9047f52d90defa75f2fd65d499f1184f1eca3548f7bb2c1d0950c5bb9038f06b" Jun 07 16:36:32.485768 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.485745 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:32.547818 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.547790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-bundle\") pod \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " Jun 07 16:36:32.547982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.547854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-util\") pod \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " Jun 07 16:36:32.547982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.547925 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcd5d\" (UniqueName: \"kubernetes.io/projected/f0044289-abd1-41ea-83ae-3c2b9a973cbf-kube-api-access-pcd5d\") pod \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\" (UID: \"f0044289-abd1-41ea-83ae-3c2b9a973cbf\") " Jun 07 16:36:32.548370 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.548347 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-bundle" (OuterVolumeSpecName: "bundle") pod "f0044289-abd1-41ea-83ae-3c2b9a973cbf" (UID: "f0044289-abd1-41ea-83ae-3c2b9a973cbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:32.550234 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.550212 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0044289-abd1-41ea-83ae-3c2b9a973cbf-kube-api-access-pcd5d" (OuterVolumeSpecName: "kube-api-access-pcd5d") pod "f0044289-abd1-41ea-83ae-3c2b9a973cbf" (UID: "f0044289-abd1-41ea-83ae-3c2b9a973cbf"). InnerVolumeSpecName "kube-api-access-pcd5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:36:32.553007 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.552974 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-util" (OuterVolumeSpecName: "util") pod "f0044289-abd1-41ea-83ae-3c2b9a973cbf" (UID: "f0044289-abd1-41ea-83ae-3c2b9a973cbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:36:32.649102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.649043 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:32.649102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.649065 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0044289-abd1-41ea-83ae-3c2b9a973cbf-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:32.649102 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:32.649073 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcd5d\" (UniqueName: \"kubernetes.io/projected/f0044289-abd1-41ea-83ae-3c2b9a973cbf-kube-api-access-pcd5d\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:36:33.363750 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:33.363660 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" event={"ID":"f0044289-abd1-41ea-83ae-3c2b9a973cbf","Type":"ContainerDied","Data":"60fe96ace351007cce6dacb97b6f6b93b86a73d271984b77fa425ace4f5b0031"} Jun 07 16:36:33.363750 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:33.363717 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk" Jun 07 16:36:33.363750 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:33.363727 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60fe96ace351007cce6dacb97b6f6b93b86a73d271984b77fa425ace4f5b0031" Jun 07 16:36:39.895390 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:39.895354 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:42.364787 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.364737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:42.422689 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.422659 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:42.522084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.522054 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx"] Jun 07 16:36:42.522772 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.522751 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="pull" Jun 07 16:36:42.522904 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.522893 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="pull" Jun 07 16:36:42.522979 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.522969 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="util" Jun 07 16:36:42.523046 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523027 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="util" Jun 07 16:36:42.523106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523050 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="pull" Jun 07 16:36:42.523106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523058 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="pull" Jun 07 16:36:42.523106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523068 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="extract" Jun 07 16:36:42.523106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523076 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="extract" Jun 07 16:36:42.523106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523091 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="pull" Jun 07 16:36:42.523106 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523100 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="pull" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523128 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="util" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523137 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="util" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523150 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523159 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523171 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523179 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523197 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="pull" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523205 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="pull" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523217 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523226 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523237 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="util" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523244 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="util" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523254 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="util" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523261 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="util" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523365 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae47d64-00a9-448f-adf6-e49473cf65a2" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523380 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0044289-abd1-41ea-83ae-3c2b9a973cbf" containerName="extract" Jun 07 16:36:42.523384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523390 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="265fba23-09d8-4486-b119-8647fb0b72a6" containerName="extract" Jun 07 16:36:42.524138 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.523399 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="53ddaf8b-469b-464b-b184-ffaf4e677183" containerName="extract" Jun 07 16:36:42.526888 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.526869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:42.529424 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.529404 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 07 16:36:42.529516 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.529498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-djqzb\"" Jun 07 16:36:42.535536 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.535516 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx"] Jun 07 16:36:42.630756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.630673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5nv\" (UniqueName: \"kubernetes.io/projected/7a558bfb-65cf-4977-8a54-5faa40337644-kube-api-access-wb5nv\") pod \"dns-operator-controller-manager-864dd78c4c-7c2zx\" (UID: \"7a558bfb-65cf-4977-8a54-5faa40337644\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:42.732096 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.732060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5nv\" (UniqueName: \"kubernetes.io/projected/7a558bfb-65cf-4977-8a54-5faa40337644-kube-api-access-wb5nv\") pod \"dns-operator-controller-manager-864dd78c4c-7c2zx\" (UID: \"7a558bfb-65cf-4977-8a54-5faa40337644\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:42.741842 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.741818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5nv\" (UniqueName: \"kubernetes.io/projected/7a558bfb-65cf-4977-8a54-5faa40337644-kube-api-access-wb5nv\") pod \"dns-operator-controller-manager-864dd78c4c-7c2zx\" (UID: \"7a558bfb-65cf-4977-8a54-5faa40337644\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:42.838210 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.838173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:42.969526 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:42.969498 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx"] Jun 07 16:36:42.970475 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:42.970454 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a558bfb_65cf_4977_8a54_5faa40337644.slice/crio-606e3dd5945237390dad81757cf9da96193b422832ad0b2c4df0255b663f693b WatchSource:0}: Error finding container 606e3dd5945237390dad81757cf9da96193b422832ad0b2c4df0255b663f693b: Status 404 returned error can't find the container with id 606e3dd5945237390dad81757cf9da96193b422832ad0b2c4df0255b663f693b Jun 07 16:36:43.422293 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:43.422260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" event={"ID":"7a558bfb-65cf-4977-8a54-5faa40337644","Type":"ContainerStarted","Data":"606e3dd5945237390dad81757cf9da96193b422832ad0b2c4df0255b663f693b"} Jun 07 16:36:43.483432 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:43.483397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:45.438437 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:45.438401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" event={"ID":"7a558bfb-65cf-4977-8a54-5faa40337644","Type":"ContainerStarted","Data":"4ebdfe633fbd459cb6e118ce571792ed7dd09459c8347a95ad279af389be7bd1"} Jun 07 16:36:45.438922 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:45.438586 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:45.460089 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:45.460042 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" podStartSLOduration=1.447415495 podStartE2EDuration="3.46002703s" totalImagesPullingTime="2.012611535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:36:45.457753116 +0000 UTC m=+574.861101787" watchObservedRunningTime="2026-06-07 16:36:45.46002703 +0000 UTC m=+574.863375701" Jun 07 16:36:46.518210 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:46.518173 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:48.004032 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.003992 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:48.028712 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.028683 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq"] Jun 07 16:36:48.032284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.032261 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.034762 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.034745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gjcgx\"" Jun 07 16:36:48.047466 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.047448 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq"] Jun 07 16:36:48.183771 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.183738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9209b632-0db9-4c05-959f-b2ff095e0181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.183924 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.183790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpj7\" (UniqueName: \"kubernetes.io/projected/9209b632-0db9-4c05-959f-b2ff095e0181-kube-api-access-plpj7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.279946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.279866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:48.285156 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.285135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9209b632-0db9-4c05-959f-b2ff095e0181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.285226 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.285182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpj7\" (UniqueName: \"kubernetes.io/projected/9209b632-0db9-4c05-959f-b2ff095e0181-kube-api-access-plpj7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.285503 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.285480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9209b632-0db9-4c05-959f-b2ff095e0181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.293177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.293157 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpj7\" (UniqueName: \"kubernetes.io/projected/9209b632-0db9-4c05-959f-b2ff095e0181-kube-api-access-plpj7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.342240 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.342211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:48.477079 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.477053 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq"] Jun 07 16:36:48.478682 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:48.478658 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9209b632_0db9_4c05_959f_b2ff095e0181.slice/crio-f84b56d705f96b0676b28d9cde5a3120a99c7724eeaaac8e97d7f408d5e6c476 WatchSource:0}: Error finding container f84b56d705f96b0676b28d9cde5a3120a99c7724eeaaac8e97d7f408d5e6c476: Status 404 returned error can't find the container with id f84b56d705f96b0676b28d9cde5a3120a99c7724eeaaac8e97d7f408d5e6c476 Jun 07 16:36:48.893652 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:48.893600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:49.463121 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:49.463043 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" event={"ID":"9209b632-0db9-4c05-959f-b2ff095e0181","Type":"ContainerStarted","Data":"f84b56d705f96b0676b28d9cde5a3120a99c7724eeaaac8e97d7f408d5e6c476"} Jun 07 16:36:51.309946 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.309903 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt"] Jun 07 16:36:51.314176 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.314146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:36:51.316729 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.316707 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q4gtf\"" Jun 07 16:36:51.320776 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.320691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlhtl\" (UniqueName: \"kubernetes.io/projected/c5daff9d-0753-4423-8352-0468b881fb72-kube-api-access-qlhtl\") pod \"authorino-operator-75cc8d5cb7-gfqmt\" (UID: \"c5daff9d-0753-4423-8352-0468b881fb72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:36:51.332857 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.332832 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt"] Jun 07 16:36:51.382729 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.382708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:51.421535 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.421515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlhtl\" (UniqueName: \"kubernetes.io/projected/c5daff9d-0753-4423-8352-0468b881fb72-kube-api-access-qlhtl\") pod \"authorino-operator-75cc8d5cb7-gfqmt\" (UID: \"c5daff9d-0753-4423-8352-0468b881fb72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:36:51.439281 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.439253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlhtl\" (UniqueName: \"kubernetes.io/projected/c5daff9d-0753-4423-8352-0468b881fb72-kube-api-access-qlhtl\") pod \"authorino-operator-75cc8d5cb7-gfqmt\" (UID: \"c5daff9d-0753-4423-8352-0468b881fb72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:36:51.626757 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.626664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:36:51.782370 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:51.782346 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt"] Jun 07 16:36:51.785408 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:36:51.785378 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5daff9d_0753_4423_8352_0468b881fb72.slice/crio-86ec55c32283443b8ebca4950b46ef95c096f9723e944dd35dc7cec6b0986d54 WatchSource:0}: Error finding container 86ec55c32283443b8ebca4950b46ef95c096f9723e944dd35dc7cec6b0986d54: Status 404 returned error can't find the container with id 86ec55c32283443b8ebca4950b46ef95c096f9723e944dd35dc7cec6b0986d54 Jun 07 16:36:52.279266 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:52.279229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:52.484364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:52.484332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" event={"ID":"c5daff9d-0753-4423-8352-0468b881fb72","Type":"ContainerStarted","Data":"86ec55c32283443b8ebca4950b46ef95c096f9723e944dd35dc7cec6b0986d54"} Jun 07 16:36:53.495977 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:53.495938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" event={"ID":"9209b632-0db9-4c05-959f-b2ff095e0181","Type":"ContainerStarted","Data":"a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40"} Jun 07 16:36:53.496415 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:53.496134 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:36:53.516480 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:53.515989 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" podStartSLOduration=0.799615546 podStartE2EDuration="5.515969744s" totalImagesPullingTime="4.716354198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:36:53.515320294 +0000 UTC m=+582.918668975" watchObservedRunningTime="2026-06-07 16:36:53.515969744 +0000 UTC m=+582.919318415" Jun 07 16:36:54.152755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:54.152720 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:55.508817 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:55.508779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" event={"ID":"c5daff9d-0753-4423-8352-0468b881fb72","Type":"ContainerStarted","Data":"2061e1429366316afe26a8dcdddcad936f8233f2644050716c63570f0a5071d5"} Jun 07 16:36:55.509261 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:55.508838 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:36:55.525322 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:55.525271 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" podStartSLOduration=1.420430176 podStartE2EDuration="4.525254002s" totalImagesPullingTime="3.104823826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:36:55.524568203 +0000 UTC m=+584.927916877" watchObservedRunningTime="2026-06-07 16:36:55.525254002 +0000 UTC m=+584.928602674" Jun 07 16:36:55.694806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:55.694774 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:55.790374 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:55.790303 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:56.219953 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:56.219872 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:56.445657 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:56.445612 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7c2zx" Jun 07 16:36:56.921957 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:56.921925 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:59.282476 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:59.282445 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:36:59.390432 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:36:59.390401 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:04.504186 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:04.504160 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.091166 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.091134 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq"] Jun 07 16:37:06.094772 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.094752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.111273 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.111253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq"] Jun 07 16:37:06.157378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.157351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxxs\" (UniqueName: \"kubernetes.io/projected/882cdb6d-66f5-47c7-a492-cf1f17be56d7-kube-api-access-vjxxs\") pod \"kuadrant-operator-controller-manager-86878c769f-wknxq\" (UID: \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.157486 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.157408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/882cdb6d-66f5-47c7-a492-cf1f17be56d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wknxq\" (UID: \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.165907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.165882 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq"] Jun 07 16:37:06.166155 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.166107 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" containerName="manager" containerID="cri-o://a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40" gracePeriod=2 Jun 07 16:37:06.177130 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.177110 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq"] Jun 07 16:37:06.190547 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.190521 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq"] Jun 07 16:37:06.190668 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.190597 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9209b632-0db9-4c05-959f-b2ff095e0181\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xffzq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.190907 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.190884 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vjxxs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" podUID="882cdb6d-66f5-47c7-a492-cf1f17be56d7" Jun 07 16:37:06.193372 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.193350 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm"] Jun 07 16:37:06.194011 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.193954 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" containerName="manager" Jun 07 16:37:06.194011 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.193976 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" containerName="manager" Jun 07 16:37:06.194167 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.194131 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" containerName="manager" Jun 07 16:37:06.197327 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.197308 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq"] Jun 07 16:37:06.197438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.197424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.208199 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.208177 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm"] Jun 07 16:37:06.221305 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.221283 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx"] Jun 07 16:37:06.224659 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.224626 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.228825 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.228796 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.230822 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.230793 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.238131 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.238109 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx"] Jun 07 16:37:06.257972 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.257942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/882cdb6d-66f5-47c7-a492-cf1f17be56d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wknxq\" (UID: \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.258073 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.258057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90e7323c-517e-40c9-b69e-655bc304f94a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wg5mm\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.258133 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.258090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblv9\" (UniqueName: \"kubernetes.io/projected/90e7323c-517e-40c9-b69e-655bc304f94a-kube-api-access-bblv9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wg5mm\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.258133 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.258124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxxs\" (UniqueName: \"kubernetes.io/projected/882cdb6d-66f5-47c7-a492-cf1f17be56d7-kube-api-access-vjxxs\") pod \"kuadrant-operator-controller-manager-86878c769f-wknxq\" (UID: \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.258253 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.258236 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/882cdb6d-66f5-47c7-a492-cf1f17be56d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wknxq\" (UID: \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.262791 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.262774 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vjxxs for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-wknxq" not found Jun 07 16:37:06.262875 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.262829 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/882cdb6d-66f5-47c7-a492-cf1f17be56d7-kube-api-access-vjxxs podName:882cdb6d-66f5-47c7-a492-cf1f17be56d7 nodeName:}" failed. No retries permitted until 2026-06-07 16:37:06.762814302 +0000 UTC m=+596.166162952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vjxxs" (UniqueName: "kubernetes.io/projected/882cdb6d-66f5-47c7-a492-cf1f17be56d7-kube-api-access-vjxxs") pod "kuadrant-operator-controller-manager-86878c769f-wknxq" (UID: "882cdb6d-66f5-47c7-a492-cf1f17be56d7") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-wknxq" not found Jun 07 16:37:06.359350 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.359316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90e7323c-517e-40c9-b69e-655bc304f94a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wg5mm\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.359503 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.359359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblv9\" (UniqueName: \"kubernetes.io/projected/90e7323c-517e-40c9-b69e-655bc304f94a-kube-api-access-bblv9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wg5mm\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.359569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.359547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvdxz\" (UniqueName: \"kubernetes.io/projected/337167f8-546f-4920-9eec-b363579d2bc2-kube-api-access-mvdxz\") pod \"kuadrant-operator-controller-manager-86878c769f-rb4xx\" (UID: \"337167f8-546f-4920-9eec-b363579d2bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.359623 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.359609 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/337167f8-546f-4920-9eec-b363579d2bc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rb4xx\" (UID: \"337167f8-546f-4920-9eec-b363579d2bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.359804 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.359781 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90e7323c-517e-40c9-b69e-655bc304f94a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wg5mm\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.368152 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.368127 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblv9\" (UniqueName: \"kubernetes.io/projected/90e7323c-517e-40c9-b69e-655bc304f94a-kube-api-access-bblv9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wg5mm\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.409173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.409155 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.411581 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.411559 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.460612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.460590 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9209b632-0db9-4c05-959f-b2ff095e0181-extensions-socket-volume\") pod \"9209b632-0db9-4c05-959f-b2ff095e0181\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " Jun 07 16:37:06.460734 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.460696 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plpj7\" (UniqueName: \"kubernetes.io/projected/9209b632-0db9-4c05-959f-b2ff095e0181-kube-api-access-plpj7\") pod \"9209b632-0db9-4c05-959f-b2ff095e0181\" (UID: \"9209b632-0db9-4c05-959f-b2ff095e0181\") " Jun 07 16:37:06.460861 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.460847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvdxz\" (UniqueName: \"kubernetes.io/projected/337167f8-546f-4920-9eec-b363579d2bc2-kube-api-access-mvdxz\") pod \"kuadrant-operator-controller-manager-86878c769f-rb4xx\" (UID: \"337167f8-546f-4920-9eec-b363579d2bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.460901 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.460889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/337167f8-546f-4920-9eec-b363579d2bc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rb4xx\" (UID: \"337167f8-546f-4920-9eec-b363579d2bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.461046 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.461028 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9209b632-0db9-4c05-959f-b2ff095e0181-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9209b632-0db9-4c05-959f-b2ff095e0181" (UID: "9209b632-0db9-4c05-959f-b2ff095e0181"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:37:06.461261 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.461245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/337167f8-546f-4920-9eec-b363579d2bc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rb4xx\" (UID: \"337167f8-546f-4920-9eec-b363579d2bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.462831 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.462813 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9209b632-0db9-4c05-959f-b2ff095e0181-kube-api-access-plpj7" (OuterVolumeSpecName: "kube-api-access-plpj7") pod "9209b632-0db9-4c05-959f-b2ff095e0181" (UID: "9209b632-0db9-4c05-959f-b2ff095e0181"). InnerVolumeSpecName "kube-api-access-plpj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:37:06.470137 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.470114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvdxz\" (UniqueName: \"kubernetes.io/projected/337167f8-546f-4920-9eec-b363579d2bc2-kube-api-access-mvdxz\") pod \"kuadrant-operator-controller-manager-86878c769f-rb4xx\" (UID: \"337167f8-546f-4920-9eec-b363579d2bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.516373 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.516354 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gfqmt" Jun 07 16:37:06.518800 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.518776 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.547884 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.547860 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:06.553847 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.553794 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:06.562158 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.562100 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plpj7\" (UniqueName: \"kubernetes.io/projected/9209b632-0db9-4c05-959f-b2ff095e0181-kube-api-access-plpj7\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:06.562158 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.562135 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9209b632-0db9-4c05-959f-b2ff095e0181-extensions-socket-volume\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:06.574209 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.574181 2561 generic.go:356] "Generic (PLEG): container finished" podID="9209b632-0db9-4c05-959f-b2ff095e0181" containerID="a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40" exitCode=0 Jun 07 16:37:06.574331 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.574240 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.574331 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.574280 2561 scope.go:117] "RemoveContainer" containerID="a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40" Jun 07 16:37:06.574489 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.574444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.577127 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.576963 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.579442 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.579361 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wknxq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="882cdb6d-66f5-47c7-a492-cf1f17be56d7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.581696 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.581663 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.583627 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.583607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.586283 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.586254 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wknxq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="882cdb6d-66f5-47c7-a492-cf1f17be56d7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.587202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.587184 2561 scope.go:117] "RemoveContainer" containerID="a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40" Jun 07 16:37:06.587563 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.587512 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40\": container with ID starting with a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40 not found: ID does not exist" containerID="a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40" Jun 07 16:37:06.587563 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.587549 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40"} err="failed to get container status \"a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40\": rpc error: code = NotFound desc = could not find container \"a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40\": container with ID starting with a15fdeb0908c566ea323313dae738968f35388d81fdf697d6cc28fdbb822dd40 not found: ID does not exist" Jun 07 16:37:06.588325 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.588280 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.590407 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.590384 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wknxq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="882cdb6d-66f5-47c7-a492-cf1f17be56d7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:06.592406 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:06.592384 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xffzq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xffzq" Jun 07 16:37:06.663930 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.663327 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/882cdb6d-66f5-47c7-a492-cf1f17be56d7-extensions-socket-volume\") pod \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\" (UID: \"882cdb6d-66f5-47c7-a492-cf1f17be56d7\") " Jun 07 16:37:06.663930 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.663713 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxxs\" (UniqueName: \"kubernetes.io/projected/882cdb6d-66f5-47c7-a492-cf1f17be56d7-kube-api-access-vjxxs\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:06.664134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.664045 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/882cdb6d-66f5-47c7-a492-cf1f17be56d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "882cdb6d-66f5-47c7-a492-cf1f17be56d7" (UID: "882cdb6d-66f5-47c7-a492-cf1f17be56d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:37:06.704378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.704354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm"] Jun 07 16:37:06.706901 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:37:06.706870 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e7323c_517e_40c9_b69e_655bc304f94a.slice/crio-beefd1328916252e3af24c1e0b1332ac37db2020ff505f48bb7d6cbe291ff670 WatchSource:0}: Error finding container beefd1328916252e3af24c1e0b1332ac37db2020ff505f48bb7d6cbe291ff670: Status 404 returned error can't find the container with id beefd1328916252e3af24c1e0b1332ac37db2020ff505f48bb7d6cbe291ff670 Jun 07 16:37:06.723833 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.723811 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx"] Jun 07 16:37:06.725485 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:37:06.725461 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337167f8_546f_4920_9eec_b363579d2bc2.slice/crio-c7b7c2c64cb2ca7aaeb496617a1e7a03c772f612a507a1656dfc92dd5ff3b858 WatchSource:0}: Error finding container c7b7c2c64cb2ca7aaeb496617a1e7a03c772f612a507a1656dfc92dd5ff3b858: Status 404 returned error can't find the container with id c7b7c2c64cb2ca7aaeb496617a1e7a03c772f612a507a1656dfc92dd5ff3b858 Jun 07 16:37:06.764351 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.764326 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/882cdb6d-66f5-47c7-a492-cf1f17be56d7-extensions-socket-volume\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:06.997790 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.997756 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="882cdb6d-66f5-47c7-a492-cf1f17be56d7" path="/var/lib/kubelet/pods/882cdb6d-66f5-47c7-a492-cf1f17be56d7/volumes" Jun 07 16:37:06.998126 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:06.998104 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9209b632-0db9-4c05-959f-b2ff095e0181" path="/var/lib/kubelet/pods/9209b632-0db9-4c05-959f-b2ff095e0181/volumes" Jun 07 16:37:07.583069 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.583018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" event={"ID":"90e7323c-517e-40c9-b69e-655bc304f94a","Type":"ContainerStarted","Data":"bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8"} Jun 07 16:37:07.583545 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.583197 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:07.583545 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.583243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" event={"ID":"90e7323c-517e-40c9-b69e-655bc304f94a","Type":"ContainerStarted","Data":"beefd1328916252e3af24c1e0b1332ac37db2020ff505f48bb7d6cbe291ff670"} Jun 07 16:37:07.585991 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.585970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:07.585991 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.585967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" event={"ID":"337167f8-546f-4920-9eec-b363579d2bc2","Type":"ContainerStarted","Data":"64a1619547074d11598c58339f8336add2a76ec45f4e2e2739070418834af6c2"} Jun 07 16:37:07.586189 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.586026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" event={"ID":"337167f8-546f-4920-9eec-b363579d2bc2","Type":"ContainerStarted","Data":"c7b7c2c64cb2ca7aaeb496617a1e7a03c772f612a507a1656dfc92dd5ff3b858"} Jun 07 16:37:07.586189 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.586108 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:07.602867 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.602814 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" podStartSLOduration=1.602803648 podStartE2EDuration="1.602803648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:07.602610829 +0000 UTC m=+597.005959499" watchObservedRunningTime="2026-06-07 16:37:07.602803648 +0000 UTC m=+597.006152318" Jun 07 16:37:07.628280 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:07.628245 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wknxq\" is forbidden: User \"system:node:ip-10-0-129-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-26.ec2.internal' and this object" podUID="882cdb6d-66f5-47c7-a492-cf1f17be56d7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wknxq" Jun 07 16:37:07.628765 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:07.628728 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" podStartSLOduration=1.628716429 podStartE2EDuration="1.628716429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:07.626046067 +0000 UTC m=+597.029394739" watchObservedRunningTime="2026-06-07 16:37:07.628716429 +0000 UTC m=+597.032065099" Jun 07 16:37:08.498873 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:08.498832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:09.802003 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:09.801971 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:10.998246 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:10.998219 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:37:10.998937 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:10.998920 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:37:11.495773 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:11.495741 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:11.596495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:11.596466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:14.101587 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:14.101553 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:14.203280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:14.203231 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:17.915954 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:17.915919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:18.017123 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:18.017086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:18.594076 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:18.594044 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:18.594280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:18.594222 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rb4xx" Jun 07 16:37:18.666425 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:18.666390 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm"] Jun 07 16:37:18.666685 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:18.666616 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" podUID="90e7323c-517e-40c9-b69e-655bc304f94a" containerName="manager" containerID="cri-o://bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8" gracePeriod=10 Jun 07 16:37:18.921530 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:18.921503 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:19.067812 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.067783 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90e7323c-517e-40c9-b69e-655bc304f94a-extensions-socket-volume\") pod \"90e7323c-517e-40c9-b69e-655bc304f94a\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " Jun 07 16:37:19.067812 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.067812 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bblv9\" (UniqueName: \"kubernetes.io/projected/90e7323c-517e-40c9-b69e-655bc304f94a-kube-api-access-bblv9\") pod \"90e7323c-517e-40c9-b69e-655bc304f94a\" (UID: \"90e7323c-517e-40c9-b69e-655bc304f94a\") " Jun 07 16:37:19.068128 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.068099 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90e7323c-517e-40c9-b69e-655bc304f94a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "90e7323c-517e-40c9-b69e-655bc304f94a" (UID: "90e7323c-517e-40c9-b69e-655bc304f94a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:37:19.069993 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.069969 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e7323c-517e-40c9-b69e-655bc304f94a-kube-api-access-bblv9" (OuterVolumeSpecName: "kube-api-access-bblv9") pod "90e7323c-517e-40c9-b69e-655bc304f94a" (UID: "90e7323c-517e-40c9-b69e-655bc304f94a"). InnerVolumeSpecName "kube-api-access-bblv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:37:19.169344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.169281 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90e7323c-517e-40c9-b69e-655bc304f94a-extensions-socket-volume\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:19.169344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.169304 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bblv9\" (UniqueName: \"kubernetes.io/projected/90e7323c-517e-40c9-b69e-655bc304f94a-kube-api-access-bblv9\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:19.480730 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.480649 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:19.573223 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.573193 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:19.653597 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.653565 2561 generic.go:356] "Generic (PLEG): container finished" podID="90e7323c-517e-40c9-b69e-655bc304f94a" containerID="bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8" exitCode=0 Jun 07 16:37:19.653756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.653609 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" Jun 07 16:37:19.653756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.653667 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" event={"ID":"90e7323c-517e-40c9-b69e-655bc304f94a","Type":"ContainerDied","Data":"bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8"} Jun 07 16:37:19.653756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.653724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm" event={"ID":"90e7323c-517e-40c9-b69e-655bc304f94a","Type":"ContainerDied","Data":"beefd1328916252e3af24c1e0b1332ac37db2020ff505f48bb7d6cbe291ff670"} Jun 07 16:37:19.653756 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.653748 2561 scope.go:117] "RemoveContainer" containerID="bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8" Jun 07 16:37:19.663432 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.663414 2561 scope.go:117] "RemoveContainer" containerID="bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8" Jun 07 16:37:19.663698 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:19.663680 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8\": container with ID starting with bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8 not found: ID does not exist" containerID="bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8" Jun 07 16:37:19.663737 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.663708 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8"} err="failed to get container status \"bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8\": rpc error: code = NotFound desc = could not find container \"bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8\": container with ID starting with bbf412ba691a829c0747ccc825501aaaad91c6abf911595b4a2f97f39f2253f8 not found: ID does not exist" Jun 07 16:37:19.680194 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.680171 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm"] Jun 07 16:37:19.690568 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:19.688156 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wg5mm"] Jun 07 16:37:20.994811 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:20.994778 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e7323c-517e-40c9-b69e-655bc304f94a" path="/var/lib/kubelet/pods/90e7323c-517e-40c9-b69e-655bc304f94a/volumes" Jun 07 16:37:24.286374 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:24.286340 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:24.341779 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:24.341756 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:28.895241 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:28.895142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:28.993132 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:28.993098 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:29.502398 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:29.502364 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:29.556559 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:29.556531 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:33.507990 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:33.507954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:33.615509 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:33.615478 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:34.959956 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:34.959927 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:35.056926 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:35.056891 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:38.294141 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:38.294113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:39.225667 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.225615 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:39.349325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.349283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:39.450355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.450315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:39.632415 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.632381 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:37:39.632823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.632811 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e7323c-517e-40c9-b69e-655bc304f94a" containerName="manager" Jun 07 16:37:39.632823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.632825 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e7323c-517e-40c9-b69e-655bc304f94a" containerName="manager" Jun 07 16:37:39.632945 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.632899 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e7323c-517e-40c9-b69e-655bc304f94a" containerName="manager" Jun 07 16:37:39.636413 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.636390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.640973 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.640849 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qg4pn\"" Jun 07 16:37:39.642138 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.642114 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 16:37:39.644755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.644732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a22fa0c-8fa2-4e20-82b8-0d1477607b58-config-file\") pod \"limitador-limitador-54d6d988d5-zz9vl\" (UID: \"2a22fa0c-8fa2-4e20-82b8-0d1477607b58\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.644876 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.644819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qx9\" (UniqueName: \"kubernetes.io/projected/2a22fa0c-8fa2-4e20-82b8-0d1477607b58-kube-api-access-s2qx9\") pod \"limitador-limitador-54d6d988d5-zz9vl\" (UID: \"2a22fa0c-8fa2-4e20-82b8-0d1477607b58\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.645491 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.645477 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:37:39.653909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.653886 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:37:39.745318 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.745290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a22fa0c-8fa2-4e20-82b8-0d1477607b58-config-file\") pod \"limitador-limitador-54d6d988d5-zz9vl\" (UID: \"2a22fa0c-8fa2-4e20-82b8-0d1477607b58\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.745459 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.745346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qx9\" (UniqueName: \"kubernetes.io/projected/2a22fa0c-8fa2-4e20-82b8-0d1477607b58-kube-api-access-s2qx9\") pod \"limitador-limitador-54d6d988d5-zz9vl\" (UID: \"2a22fa0c-8fa2-4e20-82b8-0d1477607b58\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.745948 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.745923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a22fa0c-8fa2-4e20-82b8-0d1477607b58-config-file\") pod \"limitador-limitador-54d6d988d5-zz9vl\" (UID: \"2a22fa0c-8fa2-4e20-82b8-0d1477607b58\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.753512 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.753490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qx9\" (UniqueName: \"kubernetes.io/projected/2a22fa0c-8fa2-4e20-82b8-0d1477607b58-kube-api-access-s2qx9\") pod \"limitador-limitador-54d6d988d5-zz9vl\" (UID: \"2a22fa0c-8fa2-4e20-82b8-0d1477607b58\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:39.950957 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:39.950874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:40.054767 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.054733 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6dk58"] Jun 07 16:37:40.059988 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.059964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:40.062750 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.062619 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7bl5\"" Jun 07 16:37:40.064091 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.064048 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6dk58"] Jun 07 16:37:40.081767 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.081743 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:40.089182 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.089163 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:37:40.090376 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:37:40.090355 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a22fa0c_8fa2_4e20_82b8_0d1477607b58.slice/crio-f007b17b1ce17db40a590ba31982e3812e8ccfa4565e5347251bac53e0422e01 WatchSource:0}: Error finding container f007b17b1ce17db40a590ba31982e3812e8ccfa4565e5347251bac53e0422e01: Status 404 returned error can't find the container with id f007b17b1ce17db40a590ba31982e3812e8ccfa4565e5347251bac53e0422e01 Jun 07 16:37:40.092067 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.092053 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:37:40.148193 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.148173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pnq\" (UniqueName: \"kubernetes.io/projected/491d13ee-1cba-46b8-a940-c0e060c62104-kube-api-access-q2pnq\") pod \"authorino-58cd955675-6dk58\" (UID: \"491d13ee-1cba-46b8-a940-c0e060c62104\") " pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:40.170355 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.170330 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:40.249094 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.249071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pnq\" (UniqueName: \"kubernetes.io/projected/491d13ee-1cba-46b8-a940-c0e060c62104-kube-api-access-q2pnq\") pod \"authorino-58cd955675-6dk58\" (UID: \"491d13ee-1cba-46b8-a940-c0e060c62104\") " pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:40.256577 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.256555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pnq\" (UniqueName: \"kubernetes.io/projected/491d13ee-1cba-46b8-a940-c0e060c62104-kube-api-access-q2pnq\") pod \"authorino-58cd955675-6dk58\" (UID: \"491d13ee-1cba-46b8-a940-c0e060c62104\") " pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:40.371897 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.371876 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:40.512841 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.512671 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6dk58"] Jun 07 16:37:40.514839 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:37:40.514797 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod491d13ee_1cba_46b8_a940_c0e060c62104.slice/crio-aadf259b2706f454500d9d4932ea38c3d31254c91b02af07db7fd53be1c0f49f WatchSource:0}: Error finding container aadf259b2706f454500d9d4932ea38c3d31254c91b02af07db7fd53be1c0f49f: Status 404 returned error can't find the container with id aadf259b2706f454500d9d4932ea38c3d31254c91b02af07db7fd53be1c0f49f Jun 07 16:37:40.786314 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.786227 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" event={"ID":"2a22fa0c-8fa2-4e20-82b8-0d1477607b58","Type":"ContainerStarted","Data":"f007b17b1ce17db40a590ba31982e3812e8ccfa4565e5347251bac53e0422e01"} Jun 07 16:37:40.787889 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:40.787859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6dk58" event={"ID":"491d13ee-1cba-46b8-a940-c0e060c62104","Type":"ContainerStarted","Data":"aadf259b2706f454500d9d4932ea38c3d31254c91b02af07db7fd53be1c0f49f"} Jun 07 16:37:43.354869 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.354837 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5675bfb7c8-ltgtr"] Jun 07 16:37:43.361427 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.360238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.370491 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.370464 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5675bfb7c8-ltgtr"] Jun 07 16:37:43.376202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-service-ca\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.376319 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-oauth-serving-cert\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.376319 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba6cbf84-8eda-4496-9719-05a46d98a598-console-serving-cert\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.376420 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-console-config\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.376420 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba6cbf84-8eda-4496-9719-05a46d98a598-console-oauth-config\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.376420 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5th4l\" (UniqueName: \"kubernetes.io/projected/ba6cbf84-8eda-4496-9719-05a46d98a598-kube-api-access-5th4l\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.376559 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.376430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-trusted-ca-bundle\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.402673 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.402610 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:43.476908 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.476876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5th4l\" (UniqueName: \"kubernetes.io/projected/ba6cbf84-8eda-4496-9719-05a46d98a598-kube-api-access-5th4l\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.476908 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.476921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-trusted-ca-bundle\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.476992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-service-ca\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-oauth-serving-cert\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba6cbf84-8eda-4496-9719-05a46d98a598-console-serving-cert\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477303 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-console-config\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477303 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba6cbf84-8eda-4496-9719-05a46d98a598-console-oauth-config\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477877 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-trusted-ca-bundle\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477877 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-oauth-serving-cert\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.477877 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-service-ca\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.478110 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.477895 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba6cbf84-8eda-4496-9719-05a46d98a598-console-config\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.480277 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.480254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba6cbf84-8eda-4496-9719-05a46d98a598-console-oauth-config\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.480391 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.480367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba6cbf84-8eda-4496-9719-05a46d98a598-console-serving-cert\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.486045 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.486024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5th4l\" (UniqueName: \"kubernetes.io/projected/ba6cbf84-8eda-4496-9719-05a46d98a598-kube-api-access-5th4l\") pod \"console-5675bfb7c8-ltgtr\" (UID: \"ba6cbf84-8eda-4496-9719-05a46d98a598\") " pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:43.497515 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.497459 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:43.598177 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.598139 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:43.678078 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:43.678003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:44.150137 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.150106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:44.249968 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.249930 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:44.451474 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.451444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5675bfb7c8-ltgtr"] Jun 07 16:37:44.454108 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:37:44.454072 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6cbf84_8eda_4496_9719_05a46d98a598.slice/crio-8b468a3c008100adc2c0b8d95101578b21e3c89be18d25cefa6988a12a50b361 WatchSource:0}: Error finding container 8b468a3c008100adc2c0b8d95101578b21e3c89be18d25cefa6988a12a50b361: Status 404 returned error can't find the container with id 8b468a3c008100adc2c0b8d95101578b21e3c89be18d25cefa6988a12a50b361 Jun 07 16:37:44.817477 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.817446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6dk58" event={"ID":"491d13ee-1cba-46b8-a940-c0e060c62104","Type":"ContainerStarted","Data":"0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210"} Jun 07 16:37:44.818977 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.818951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5675bfb7c8-ltgtr" event={"ID":"ba6cbf84-8eda-4496-9719-05a46d98a598","Type":"ContainerStarted","Data":"9baae73036a1668674ee368b19824eb2d00e0b59b215d991b2861d9112bf4aba"} Jun 07 16:37:44.819109 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.818996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5675bfb7c8-ltgtr" event={"ID":"ba6cbf84-8eda-4496-9719-05a46d98a598","Type":"ContainerStarted","Data":"8b468a3c008100adc2c0b8d95101578b21e3c89be18d25cefa6988a12a50b361"} Jun 07 16:37:44.820384 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.820364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" event={"ID":"2a22fa0c-8fa2-4e20-82b8-0d1477607b58","Type":"ContainerStarted","Data":"e354842bd3365d5b1b837a4345bb52e7e1acaf02d862252082049e941aa0b9aa"} Jun 07 16:37:44.820481 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.820442 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:37:44.833881 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.833842 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6dk58" podStartSLOduration=1.021266083 podStartE2EDuration="4.833831862s" totalImagesPullingTime="3.812565779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:44.831690361 +0000 UTC m=+634.235039033" watchObservedRunningTime="2026-06-07 16:37:44.833831862 +0000 UTC m=+634.237180541" Jun 07 16:37:44.847869 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.847810 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" podStartSLOduration=1.6248627500000001 podStartE2EDuration="5.847792554s" totalImagesPullingTime="4.222929804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:44.846035923 +0000 UTC m=+634.249384597" watchObservedRunningTime="2026-06-07 16:37:44.847792554 +0000 UTC m=+634.251141227" Jun 07 16:37:44.862528 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:44.862482 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5675bfb7c8-ltgtr" podStartSLOduration=1.8624690830000001 podStartE2EDuration="1.862469083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:44.861006117 +0000 UTC m=+634.264354810" watchObservedRunningTime="2026-06-07 16:37:44.862469083 +0000 UTC m=+634.265817753" Jun 07 16:37:45.008913 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:45.008875 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6dk58"] Jun 07 16:37:46.831754 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:46.831717 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6dk58" podUID="491d13ee-1cba-46b8-a940-c0e060c62104" containerName="authorino" containerID="cri-o://0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210" gracePeriod=30 Jun 07 16:37:47.076744 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.076722 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:47.109672 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.109589 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2pnq\" (UniqueName: \"kubernetes.io/projected/491d13ee-1cba-46b8-a940-c0e060c62104-kube-api-access-q2pnq\") pod \"491d13ee-1cba-46b8-a940-c0e060c62104\" (UID: \"491d13ee-1cba-46b8-a940-c0e060c62104\") " Jun 07 16:37:47.111602 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.111577 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491d13ee-1cba-46b8-a940-c0e060c62104-kube-api-access-q2pnq" (OuterVolumeSpecName: "kube-api-access-q2pnq") pod "491d13ee-1cba-46b8-a940-c0e060c62104" (UID: "491d13ee-1cba-46b8-a940-c0e060c62104"). InnerVolumeSpecName "kube-api-access-q2pnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:37:47.211229 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.211203 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2pnq\" (UniqueName: \"kubernetes.io/projected/491d13ee-1cba-46b8-a940-c0e060c62104-kube-api-access-q2pnq\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:37:47.839394 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.839358 2561 generic.go:356] "Generic (PLEG): container finished" podID="491d13ee-1cba-46b8-a940-c0e060c62104" containerID="0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210" exitCode=0 Jun 07 16:37:47.839394 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.839394 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6dk58" event={"ID":"491d13ee-1cba-46b8-a940-c0e060c62104","Type":"ContainerDied","Data":"0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210"} Jun 07 16:37:47.839909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.839405 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6dk58" Jun 07 16:37:47.839909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.839420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6dk58" event={"ID":"491d13ee-1cba-46b8-a940-c0e060c62104","Type":"ContainerDied","Data":"aadf259b2706f454500d9d4932ea38c3d31254c91b02af07db7fd53be1c0f49f"} Jun 07 16:37:47.839909 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.839437 2561 scope.go:117] "RemoveContainer" containerID="0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210" Jun 07 16:37:47.848655 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.848609 2561 scope.go:117] "RemoveContainer" containerID="0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210" Jun 07 16:37:47.848892 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:37:47.848874 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210\": container with ID starting with 0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210 not found: ID does not exist" containerID="0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210" Jun 07 16:37:47.848959 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.848898 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210"} err="failed to get container status \"0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210\": rpc error: code = NotFound desc = could not find container \"0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210\": container with ID starting with 0c30de43ffcaf7b924b1087e8b304cee7a04a5c42b6eed501c11146b3e41e210 not found: ID does not exist" Jun 07 16:37:47.860068 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.860046 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6dk58"] Jun 07 16:37:47.863166 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:47.863146 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6dk58"] Jun 07 16:37:48.995490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:48.995457 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491d13ee-1cba-46b8-a940-c0e060c62104" path="/var/lib/kubelet/pods/491d13ee-1cba-46b8-a940-c0e060c62104/volumes" Jun 07 16:37:53.679198 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:53.679151 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:53.679574 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:53.679221 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:53.683990 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:53.683968 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:53.878612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:53.878586 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5675bfb7c8-ltgtr" Jun 07 16:37:53.919588 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:53.919552 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cc47c76b-zv4xg"] Jun 07 16:37:54.048715 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:54.048686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:54.153051 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:54.153019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:54.249623 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:54.249598 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:37:55.827739 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:37:55.827712 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zz9vl" Jun 07 16:38:00.382612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:00.382576 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:00.484332 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:00.484302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:00.862172 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:00.862131 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:11.238978 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:11.238941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:11.337186 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:11.337109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:11.487278 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:11.487244 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:12.335322 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.335287 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc"] Jun 07 16:38:12.335741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.335728 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="491d13ee-1cba-46b8-a940-c0e060c62104" containerName="authorino" Jun 07 16:38:12.335741 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.335742 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="491d13ee-1cba-46b8-a940-c0e060c62104" containerName="authorino" Jun 07 16:38:12.335823 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.335817 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="491d13ee-1cba-46b8-a940-c0e060c62104" containerName="authorino" Jun 07 16:38:12.342146 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.342113 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.344660 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.344619 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 07 16:38:12.344660 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.344651 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 07 16:38:12.344843 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.344700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j8nkm\"" Jun 07 16:38:12.345142 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.345120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc"] Jun 07 16:38:12.432999 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.432970 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.433141 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.433012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh2xf\" (UniqueName: \"kubernetes.io/projected/9c951988-77a5-4be3-9c0c-7ef70bb88518-kube-api-access-vh2xf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.433141 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.433080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.534323 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.534293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.534465 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.534389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.534465 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.534456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh2xf\" (UniqueName: \"kubernetes.io/projected/9c951988-77a5-4be3-9c0c-7ef70bb88518-kube-api-access-vh2xf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.534780 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.534761 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.534831 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.534777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.543181 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.543157 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh2xf\" (UniqueName: \"kubernetes.io/projected/9c951988-77a5-4be3-9c0c-7ef70bb88518-kube-api-access-vh2xf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.653160 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.653101 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:12.788318 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.788290 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc"] Jun 07 16:38:12.788752 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:38:12.788726 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c951988_77a5_4be3_9c0c_7ef70bb88518.slice/crio-e199cf861e1b10d8e0ac1831984652ed0720a47d7097508d00308ded0306fca7 WatchSource:0}: Error finding container e199cf861e1b10d8e0ac1831984652ed0720a47d7097508d00308ded0306fca7: Status 404 returned error can't find the container with id e199cf861e1b10d8e0ac1831984652ed0720a47d7097508d00308ded0306fca7 Jun 07 16:38:12.985219 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.985147 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerID="07fd1f6308de546c30e2f21bbd95d5b826f7a6e392c500dc3e1ac63f699dca91" exitCode=0 Jun 07 16:38:12.985347 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.985242 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" event={"ID":"9c951988-77a5-4be3-9c0c-7ef70bb88518","Type":"ContainerDied","Data":"07fd1f6308de546c30e2f21bbd95d5b826f7a6e392c500dc3e1ac63f699dca91"} Jun 07 16:38:12.985347 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:12.985296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" event={"ID":"9c951988-77a5-4be3-9c0c-7ef70bb88518","Type":"ContainerStarted","Data":"e199cf861e1b10d8e0ac1831984652ed0720a47d7097508d00308ded0306fca7"} Jun 07 16:38:13.992998 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:13.992964 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerID="a204496183cecf8a193851605794762585b1f103ad57a9f5a5e25c92e51abb62" exitCode=0 Jun 07 16:38:13.993541 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:13.993051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" event={"ID":"9c951988-77a5-4be3-9c0c-7ef70bb88518","Type":"ContainerDied","Data":"a204496183cecf8a193851605794762585b1f103ad57a9f5a5e25c92e51abb62"} Jun 07 16:38:14.697718 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:14.697679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:14.999952 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:14.999924 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerID="04bb0cee343eeaa315b36aed5a9c444885f0438df410857fc8b4b6578dde794b" exitCode=0 Jun 07 16:38:15.000335 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:15.000014 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" event={"ID":"9c951988-77a5-4be3-9c0c-7ef70bb88518","Type":"ContainerDied","Data":"04bb0cee343eeaa315b36aed5a9c444885f0438df410857fc8b4b6578dde794b"} Jun 07 16:38:16.177196 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.177167 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:16.270356 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.270289 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-util\") pod \"9c951988-77a5-4be3-9c0c-7ef70bb88518\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " Jun 07 16:38:16.270479 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.270395 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-bundle\") pod \"9c951988-77a5-4be3-9c0c-7ef70bb88518\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " Jun 07 16:38:16.270479 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.270420 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh2xf\" (UniqueName: \"kubernetes.io/projected/9c951988-77a5-4be3-9c0c-7ef70bb88518-kube-api-access-vh2xf\") pod \"9c951988-77a5-4be3-9c0c-7ef70bb88518\" (UID: \"9c951988-77a5-4be3-9c0c-7ef70bb88518\") " Jun 07 16:38:16.270906 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.270881 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-bundle" (OuterVolumeSpecName: "bundle") pod "9c951988-77a5-4be3-9c0c-7ef70bb88518" (UID: "9c951988-77a5-4be3-9c0c-7ef70bb88518"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:38:16.272650 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.272607 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c951988-77a5-4be3-9c0c-7ef70bb88518-kube-api-access-vh2xf" (OuterVolumeSpecName: "kube-api-access-vh2xf") pod "9c951988-77a5-4be3-9c0c-7ef70bb88518" (UID: "9c951988-77a5-4be3-9c0c-7ef70bb88518"). InnerVolumeSpecName "kube-api-access-vh2xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:38:16.276155 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.276136 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-util" (OuterVolumeSpecName: "util") pod "9c951988-77a5-4be3-9c0c-7ef70bb88518" (UID: "9c951988-77a5-4be3-9c0c-7ef70bb88518"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:38:16.371546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.371523 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:16.371546 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.371545 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh2xf\" (UniqueName: \"kubernetes.io/projected/9c951988-77a5-4be3-9c0c-7ef70bb88518-kube-api-access-vh2xf\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:16.371709 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:16.371555 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c951988-77a5-4be3-9c0c-7ef70bb88518-util\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:17.012364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:17.012341 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" Jun 07 16:38:17.012520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:17.012373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx4wc" event={"ID":"9c951988-77a5-4be3-9c0c-7ef70bb88518","Type":"ContainerDied","Data":"e199cf861e1b10d8e0ac1831984652ed0720a47d7097508d00308ded0306fca7"} Jun 07 16:38:17.012520 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:17.012415 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e199cf861e1b10d8e0ac1831984652ed0720a47d7097508d00308ded0306fca7" Jun 07 16:38:18.948308 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:18.948248 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58cc47c76b-zv4xg" podUID="701fcdb2-e9ec-47b4-ac49-8f246b26da9c" containerName="console" containerID="cri-o://5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9" gracePeriod=15 Jun 07 16:38:19.197306 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.197280 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:38:19.298362 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298329 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-trusted-ca-bundle\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298561 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298386 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-oauth-serving-cert\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298561 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298414 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-serving-cert\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298561 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298484 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-config\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298561 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298557 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-service-ca\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298828 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298587 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkhsv\" (UniqueName: \"kubernetes.io/projected/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-kube-api-access-zkhsv\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298828 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298695 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-oauth-config\") pod \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\" (UID: \"701fcdb2-e9ec-47b4-ac49-8f246b26da9c\") " Jun 07 16:38:19.298933 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298871 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:38:19.298933 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298921 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-config" (OuterVolumeSpecName: "console-config") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:38:19.299024 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298928 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:38:19.299024 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.298997 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-service-ca" (OuterVolumeSpecName: "service-ca") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:38:19.299135 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.299088 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-oauth-serving-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:19.299135 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.299109 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-config\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:19.299231 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.299143 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-service-ca\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:19.299315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.299270 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-trusted-ca-bundle\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:19.300811 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.300786 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:38:19.300954 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.300931 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-kube-api-access-zkhsv" (OuterVolumeSpecName: "kube-api-access-zkhsv") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "kube-api-access-zkhsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:38:19.301023 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.300972 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "701fcdb2-e9ec-47b4-ac49-8f246b26da9c" (UID: "701fcdb2-e9ec-47b4-ac49-8f246b26da9c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:38:19.400030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.400001 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-serving-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:19.400030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.400023 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkhsv\" (UniqueName: \"kubernetes.io/projected/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-kube-api-access-zkhsv\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:19.400030 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:19.400032 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fcdb2-e9ec-47b4-ac49-8f246b26da9c-console-oauth-config\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:38:20.038662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.034611 2561 generic.go:356] "Generic (PLEG): container finished" podID="701fcdb2-e9ec-47b4-ac49-8f246b26da9c" containerID="5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9" exitCode=0 Jun 07 16:38:20.038662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.034807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cc47c76b-zv4xg" event={"ID":"701fcdb2-e9ec-47b4-ac49-8f246b26da9c","Type":"ContainerDied","Data":"5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9"} Jun 07 16:38:20.038662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.034866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cc47c76b-zv4xg" event={"ID":"701fcdb2-e9ec-47b4-ac49-8f246b26da9c","Type":"ContainerDied","Data":"0111077cc5d05d5ac6db99c8dfc38026a43ee6f9a405f0db352727dca5b7e24b"} Jun 07 16:38:20.038662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.034895 2561 scope.go:117] "RemoveContainer" containerID="5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9" Jun 07 16:38:20.038662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.035066 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cc47c76b-zv4xg" Jun 07 16:38:20.057584 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.057561 2561 scope.go:117] "RemoveContainer" containerID="5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9" Jun 07 16:38:20.057963 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:38:20.057938 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9\": container with ID starting with 5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9 not found: ID does not exist" containerID="5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9" Jun 07 16:38:20.058055 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.057974 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9"} err="failed to get container status \"5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9\": rpc error: code = NotFound desc = could not find container \"5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9\": container with ID starting with 5cd2bf977756ec75f2073930e0f0da2b0279e90d91a873a0be64b8fee4061bf9 not found: ID does not exist" Jun 07 16:38:20.067737 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.067715 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cc47c76b-zv4xg"] Jun 07 16:38:20.076647 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.076245 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58cc47c76b-zv4xg"] Jun 07 16:38:20.995259 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:20.995227 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="701fcdb2-e9ec-47b4-ac49-8f246b26da9c" path="/var/lib/kubelet/pods/701fcdb2-e9ec-47b4-ac49-8f246b26da9c/volumes" Jun 07 16:38:34.803090 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:34.803061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:34.989523 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:34.989491 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:38:35.298031 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.297998 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:38:35.298394 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298383 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="pull" Jun 07 16:38:35.298436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298397 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="pull" Jun 07 16:38:35.298436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298408 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="extract" Jun 07 16:38:35.298436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298413 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="extract" Jun 07 16:38:35.298436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298429 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="util" Jun 07 16:38:35.298436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298435 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="util" Jun 07 16:38:35.298583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298445 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="701fcdb2-e9ec-47b4-ac49-8f246b26da9c" containerName="console" Jun 07 16:38:35.298583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298450 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="701fcdb2-e9ec-47b4-ac49-8f246b26da9c" containerName="console" Jun 07 16:38:35.298583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298523 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c951988-77a5-4be3-9c0c-7ef70bb88518" containerName="extract" Jun 07 16:38:35.298583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.298533 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="701fcdb2-e9ec-47b4-ac49-8f246b26da9c" containerName="console" Jun 07 16:38:35.301642 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.301617 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:35.303906 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.303884 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 16:38:35.304021 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.303887 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 07 16:38:35.305104 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.304865 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gmjvx\"" Jun 07 16:38:35.305104 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.304902 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 16:38:35.308626 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.308601 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:38:35.336202 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.336178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxtvm\" (UniqueName: \"kubernetes.io/projected/c7e696a4-aa62-4593-aa0f-b9e279c5c282-kube-api-access-qxtvm\") pod \"maas-keycloak-0\" (UID: \"c7e696a4-aa62-4593-aa0f-b9e279c5c282\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:35.436843 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.436820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxtvm\" (UniqueName: \"kubernetes.io/projected/c7e696a4-aa62-4593-aa0f-b9e279c5c282-kube-api-access-qxtvm\") pod \"maas-keycloak-0\" (UID: \"c7e696a4-aa62-4593-aa0f-b9e279c5c282\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:35.445453 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.445434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxtvm\" (UniqueName: \"kubernetes.io/projected/c7e696a4-aa62-4593-aa0f-b9e279c5c282-kube-api-access-qxtvm\") pod \"maas-keycloak-0\" (UID: \"c7e696a4-aa62-4593-aa0f-b9e279c5c282\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:35.612827 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.612760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:35.769710 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:35.769685 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:38:35.771159 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:38:35.771133 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e696a4_aa62_4593_aa0f_b9e279c5c282.slice/crio-f344ffcd22a0d4acc24a6b0acb35808f530f765893d56324867a83da580dce32 WatchSource:0}: Error finding container f344ffcd22a0d4acc24a6b0acb35808f530f765893d56324867a83da580dce32: Status 404 returned error can't find the container with id f344ffcd22a0d4acc24a6b0acb35808f530f765893d56324867a83da580dce32 Jun 07 16:38:36.125114 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:36.125084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c7e696a4-aa62-4593-aa0f-b9e279c5c282","Type":"ContainerStarted","Data":"f344ffcd22a0d4acc24a6b0acb35808f530f765893d56324867a83da580dce32"} Jun 07 16:38:41.167702 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:41.167552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c7e696a4-aa62-4593-aa0f-b9e279c5c282","Type":"ContainerStarted","Data":"fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80"} Jun 07 16:38:41.186336 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:41.186279 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.085651652 podStartE2EDuration="6.186259737s" totalImagesPullingTime="5.100608085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:38:41.184022024 +0000 UTC m=+690.587370695" watchObservedRunningTime="2026-06-07 16:38:41.186259737 +0000 UTC m=+690.589608408" Jun 07 16:38:41.613467 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:41.613424 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:41.615229 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:41.615189 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:42.613751 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:42.613701 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:43.613990 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:43.613933 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:44.614105 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:44.614053 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:45.613086 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:45.613028 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:45.614130 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:45.614092 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:46.613967 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:46.613916 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:47.614162 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:47.614121 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:48.613291 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:48.613252 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:49.614049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:49.613997 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:50.614091 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:50.614041 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:51.613521 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:51.613474 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:52.613903 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:52.613862 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 07 16:38:53.735887 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:53.735848 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 07 16:38:53.753105 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:38:53.752900 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:39:03.743623 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:03.743539 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:04.374624 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:04.374593 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:04.499056 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:04.499022 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:09.861049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:09.861013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:09.956747 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:09.956714 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:10.011467 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.011436 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:10.062746 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.062707 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5886cdb686-knpxj"] Jun 07 16:39:10.081314 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.081263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:10.139900 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.139809 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5886cdb686-knpxj"] Jun 07 16:39:10.140045 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.139927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.142330 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.142293 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bhw8s\"" Jun 07 16:39:10.142330 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.142324 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 16:39:10.142511 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.142371 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 16:39:10.184043 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.184009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktq4k\" (UniqueName: \"kubernetes.io/projected/dd502007-5d2d-4b9b-b006-d458571fc9cb-kube-api-access-ktq4k\") pod \"maas-controller-5886cdb686-knpxj\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.184184 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.184083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd502007-5d2d-4b9b-b006-d458571fc9cb-webhook-cert\") pod \"maas-controller-5886cdb686-knpxj\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.284778 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.284746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd502007-5d2d-4b9b-b006-d458571fc9cb-webhook-cert\") pod \"maas-controller-5886cdb686-knpxj\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.284939 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.284799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktq4k\" (UniqueName: \"kubernetes.io/projected/dd502007-5d2d-4b9b-b006-d458571fc9cb-kube-api-access-ktq4k\") pod \"maas-controller-5886cdb686-knpxj\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.287255 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.287234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd502007-5d2d-4b9b-b006-d458571fc9cb-webhook-cert\") pod \"maas-controller-5886cdb686-knpxj\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.293499 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.293476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktq4k\" (UniqueName: \"kubernetes.io/projected/dd502007-5d2d-4b9b-b006-d458571fc9cb-kube-api-access-ktq4k\") pod \"maas-controller-5886cdb686-knpxj\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.450365 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.450273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:10.605661 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:10.605617 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5886cdb686-knpxj"] Jun 07 16:39:10.606380 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:39:10.606357 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd502007_5d2d_4b9b_b006_d458571fc9cb.slice/crio-3ada3b80a062f0a96514fa720e7bddbc042c5d17e59d4d51d6f4ca07d5a4e192 WatchSource:0}: Error finding container 3ada3b80a062f0a96514fa720e7bddbc042c5d17e59d4d51d6f4ca07d5a4e192: Status 404 returned error can't find the container with id 3ada3b80a062f0a96514fa720e7bddbc042c5d17e59d4d51d6f4ca07d5a4e192 Jun 07 16:39:11.392198 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:11.392117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5886cdb686-knpxj" event={"ID":"dd502007-5d2d-4b9b-b006-d458571fc9cb","Type":"ContainerStarted","Data":"3ada3b80a062f0a96514fa720e7bddbc042c5d17e59d4d51d6f4ca07d5a4e192"} Jun 07 16:39:12.283935 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:12.283896 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:12.386884 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:12.386851 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:12.767086 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:12.767066 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 16:39:12.951995 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:12.951960 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:13.051114 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:13.051028 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:13.405758 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:13.405665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5886cdb686-knpxj" event={"ID":"dd502007-5d2d-4b9b-b006-d458571fc9cb","Type":"ContainerStarted","Data":"9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6"} Jun 07 16:39:13.405758 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:13.405749 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:13.441620 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:13.441571 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5886cdb686-knpxj" podStartSLOduration=1.28555282 podStartE2EDuration="3.441556101s" totalImagesPullingTime="2.156003281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:13.439284879 +0000 UTC m=+722.842633549" watchObservedRunningTime="2026-06-07 16:39:13.441556101 +0000 UTC m=+722.844904771" Jun 07 16:39:24.417059 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:24.417028 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:39:44.003845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.003809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:44.046253 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.046216 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc"] Jun 07 16:39:44.051759 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.051727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.054250 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.054220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 07 16:39:44.055284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.055262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 07 16:39:44.055284 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.055282 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 07 16:39:44.055413 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.055264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-959v7\"" Jun 07 16:39:44.062025 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.062004 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc"] Jun 07 16:39:44.101173 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.101149 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:44.170794 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.170765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk24x\" (UniqueName: \"kubernetes.io/projected/273428fc-18e5-41b0-97dd-62ee7adf031a-kube-api-access-gk24x\") pod \"maas-api-7467c8bbf9-dhqwc\" (UID: \"273428fc-18e5-41b0-97dd-62ee7adf031a\") " pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.170954 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.170880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/273428fc-18e5-41b0-97dd-62ee7adf031a-maas-api-tls\") pod \"maas-api-7467c8bbf9-dhqwc\" (UID: \"273428fc-18e5-41b0-97dd-62ee7adf031a\") " pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.272324 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.272243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/273428fc-18e5-41b0-97dd-62ee7adf031a-maas-api-tls\") pod \"maas-api-7467c8bbf9-dhqwc\" (UID: \"273428fc-18e5-41b0-97dd-62ee7adf031a\") " pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.272324 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.272298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk24x\" (UniqueName: \"kubernetes.io/projected/273428fc-18e5-41b0-97dd-62ee7adf031a-kube-api-access-gk24x\") pod \"maas-api-7467c8bbf9-dhqwc\" (UID: \"273428fc-18e5-41b0-97dd-62ee7adf031a\") " pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.274851 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.274818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/273428fc-18e5-41b0-97dd-62ee7adf031a-maas-api-tls\") pod \"maas-api-7467c8bbf9-dhqwc\" (UID: \"273428fc-18e5-41b0-97dd-62ee7adf031a\") " pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.280918 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.280897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk24x\" (UniqueName: \"kubernetes.io/projected/273428fc-18e5-41b0-97dd-62ee7adf031a-kube-api-access-gk24x\") pod \"maas-api-7467c8bbf9-dhqwc\" (UID: \"273428fc-18e5-41b0-97dd-62ee7adf031a\") " pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.363671 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.363622 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:44.447072 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.447037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:44.504848 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.504823 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc"] Jun 07 16:39:44.506215 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:39:44.506190 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273428fc_18e5_41b0_97dd_62ee7adf031a.slice/crio-27a95246510fbfb7b32eff0a1db089ca6a998931d8f911dd06fceef117784a26 WatchSource:0}: Error finding container 27a95246510fbfb7b32eff0a1db089ca6a998931d8f911dd06fceef117784a26: Status 404 returned error can't find the container with id 27a95246510fbfb7b32eff0a1db089ca6a998931d8f911dd06fceef117784a26 Jun 07 16:39:44.539049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.538986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:44.593410 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.593379 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" event={"ID":"273428fc-18e5-41b0-97dd-62ee7adf031a","Type":"ContainerStarted","Data":"27a95246510fbfb7b32eff0a1db089ca6a998931d8f911dd06fceef117784a26"} Jun 07 16:39:44.709425 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:44.709394 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:39:46.562162 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:46.562136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:46.607820 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:46.607784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" event={"ID":"273428fc-18e5-41b0-97dd-62ee7adf031a","Type":"ContainerStarted","Data":"bf48cd09b6b910ecaf49e5b9cf5505ff56b381cfb1ae5acd40f7a624958ef376"} Jun 07 16:39:46.607966 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:46.607907 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:46.626256 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:46.626215 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" podStartSLOduration=1.325704505 podStartE2EDuration="2.626203268s" totalImagesPullingTime="1.300498763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:46.622815695 +0000 UTC m=+756.026164368" watchObservedRunningTime="2026-06-07 16:39:46.626203268 +0000 UTC m=+756.029551938" Jun 07 16:39:46.627629 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:46.627611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:39:52.619310 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:52.619279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-7467c8bbf9-dhqwc" Jun 07 16:39:54.420406 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:54.420375 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:39:54.420837 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:54.420544 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" containerID="cri-o://fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80" gracePeriod=30 Jun 07 16:39:56.066998 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.066971 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.171364 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.171287 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxtvm\" (UniqueName: \"kubernetes.io/projected/c7e696a4-aa62-4593-aa0f-b9e279c5c282-kube-api-access-qxtvm\") pod \"c7e696a4-aa62-4593-aa0f-b9e279c5c282\" (UID: \"c7e696a4-aa62-4593-aa0f-b9e279c5c282\") " Jun 07 16:39:56.173456 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.173431 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7e696a4-aa62-4593-aa0f-b9e279c5c282-kube-api-access-qxtvm" (OuterVolumeSpecName: "kube-api-access-qxtvm") pod "c7e696a4-aa62-4593-aa0f-b9e279c5c282" (UID: "c7e696a4-aa62-4593-aa0f-b9e279c5c282"). InnerVolumeSpecName "kube-api-access-qxtvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:39:56.272812 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.272787 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxtvm\" (UniqueName: \"kubernetes.io/projected/c7e696a4-aa62-4593-aa0f-b9e279c5c282-kube-api-access-qxtvm\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:39:56.674944 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.674909 2561 generic.go:356] "Generic (PLEG): container finished" podID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerID="fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80" exitCode=143 Jun 07 16:39:56.675095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.674966 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.675095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.674998 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c7e696a4-aa62-4593-aa0f-b9e279c5c282","Type":"ContainerDied","Data":"fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80"} Jun 07 16:39:56.675095 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.675073 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c7e696a4-aa62-4593-aa0f-b9e279c5c282","Type":"ContainerDied","Data":"f344ffcd22a0d4acc24a6b0acb35808f530f765893d56324867a83da580dce32"} Jun 07 16:39:56.675205 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.675097 2561 scope.go:117] "RemoveContainer" containerID="fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80" Jun 07 16:39:56.685388 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.685367 2561 scope.go:117] "RemoveContainer" containerID="fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80" Jun 07 16:39:56.685664 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:39:56.685620 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80\": container with ID starting with fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80 not found: ID does not exist" containerID="fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80" Jun 07 16:39:56.685739 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.685677 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80"} err="failed to get container status \"fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80\": rpc error: code = NotFound desc = could not find container \"fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80\": container with ID starting with fe865d48b211c0660bc12bf6bbd3cf7721070752a3e5008f78fbe2af609cbd80 not found: ID does not exist" Jun 07 16:39:56.697099 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.697075 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:39:56.700815 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.700796 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:39:56.721890 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.721865 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:39:56.722274 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.722261 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" Jun 07 16:39:56.722327 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.722276 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" Jun 07 16:39:56.722369 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.722339 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" containerName="keycloak" Jun 07 16:39:56.726982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.726966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.729845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.729819 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 07 16:39:56.729845 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.729832 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 16:39:56.729979 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.729863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gmjvx\"" Jun 07 16:39:56.729979 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.729916 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 16:39:56.729979 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.729917 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 07 16:39:56.736818 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.736801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:39:56.877299 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.877271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsgw\" (UniqueName: \"kubernetes.io/projected/566dc115-a4d9-47df-be3d-2c18e79a716d-kube-api-access-qdsgw\") pod \"maas-keycloak-0\" (UID: \"566dc115-a4d9-47df-be3d-2c18e79a716d\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.877423 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.877393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/566dc115-a4d9-47df-be3d-2c18e79a716d-test-realms\") pod \"maas-keycloak-0\" (UID: \"566dc115-a4d9-47df-be3d-2c18e79a716d\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.978612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.978554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/566dc115-a4d9-47df-be3d-2c18e79a716d-test-realms\") pod \"maas-keycloak-0\" (UID: \"566dc115-a4d9-47df-be3d-2c18e79a716d\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.978612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.978587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsgw\" (UniqueName: \"kubernetes.io/projected/566dc115-a4d9-47df-be3d-2c18e79a716d-kube-api-access-qdsgw\") pod \"maas-keycloak-0\" (UID: \"566dc115-a4d9-47df-be3d-2c18e79a716d\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.979263 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.979240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/566dc115-a4d9-47df-be3d-2c18e79a716d-test-realms\") pod \"maas-keycloak-0\" (UID: \"566dc115-a4d9-47df-be3d-2c18e79a716d\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.987222 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.987201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsgw\" (UniqueName: \"kubernetes.io/projected/566dc115-a4d9-47df-be3d-2c18e79a716d-kube-api-access-qdsgw\") pod \"maas-keycloak-0\" (UID: \"566dc115-a4d9-47df-be3d-2c18e79a716d\") " pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:56.996051 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:56.996027 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7e696a4-aa62-4593-aa0f-b9e279c5c282" path="/var/lib/kubelet/pods/c7e696a4-aa62-4593-aa0f-b9e279c5c282/volumes" Jun 07 16:39:57.037000 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:57.036969 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:57.170691 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:57.170666 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 16:39:57.171441 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:39:57.171411 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566dc115_a4d9_47df_be3d_2c18e79a716d.slice/crio-f4c9598317d4be96a135f78861a5f8d12c6983724b1885482a62b2716649e581 WatchSource:0}: Error finding container f4c9598317d4be96a135f78861a5f8d12c6983724b1885482a62b2716649e581: Status 404 returned error can't find the container with id f4c9598317d4be96a135f78861a5f8d12c6983724b1885482a62b2716649e581 Jun 07 16:39:57.685142 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:57.685106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"566dc115-a4d9-47df-be3d-2c18e79a716d","Type":"ContainerStarted","Data":"4c4cefc11e6d3283d4f6a5291dc978bda1b2f443a46c3370c555a6b673bd18ca"} Jun 07 16:39:57.685342 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:57.685167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"566dc115-a4d9-47df-be3d-2c18e79a716d","Type":"ContainerStarted","Data":"f4c9598317d4be96a135f78861a5f8d12c6983724b1885482a62b2716649e581"} Jun 07 16:39:57.703035 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:57.702991 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.40584667 podStartE2EDuration="1.702974748s" totalImagesPullingTime="297.128078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:57.701097465 +0000 UTC m=+767.104446135" watchObservedRunningTime="2026-06-07 16:39:57.702974748 +0000 UTC m=+767.106323453" Jun 07 16:39:58.037382 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:58.037338 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 07 16:39:58.039430 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:58.039392 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:39:59.037738 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:39:59.037695 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:00.038217 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:00.038167 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:01.038461 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:01.038406 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:02.037679 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:02.037607 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:03.038356 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:03.038306 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:04.038155 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:04.038098 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:05.038438 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:05.038382 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:06.037442 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:06.037388 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:07.038075 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:07.038042 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:40:07.038467 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:07.038320 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:08.037763 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:08.037705 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:09.037678 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:09.037606 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:10.037932 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:10.037870 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 07 16:40:11.164264 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:11.164230 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 07 16:40:11.185288 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:11.184820 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="566dc115-a4d9-47df-be3d-2c18e79a716d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:40:21.170304 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:21.170266 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 07 16:40:23.696182 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:23.696128 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:40:23.749209 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:23.749185 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:40:34.163412 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:34.163323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:40:34.261215 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:34.261186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:40:46.823159 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.823129 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8"] Jun 07 16:40:46.827049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.827023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.829781 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.829750 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 16:40:46.830574 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.830556 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 16:40:46.830666 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.830647 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 07 16:40:46.830720 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.830701 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bcmch\"" Jun 07 16:40:46.835587 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.835367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8"] Jun 07 16:40:46.854072 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.854196 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.854196 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.854315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.854315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854233 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj24f\" (UniqueName: \"kubernetes.io/projected/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-kube-api-access-cj24f\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.854315 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.854898 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.854877 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:40:46.955008 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.954982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955322 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj24f\" (UniqueName: \"kubernetes.io/projected/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-kube-api-access-cj24f\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955378 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955435 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.955492 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.955482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.957401 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.957378 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.957558 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.957543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:46.962916 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:46.962892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj24f\" (UniqueName: \"kubernetes.io/projected/2deea20a-12f5-47a7-beb2-4b81cb5d4b41-kube-api-access-cj24f\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8\" (UID: \"2deea20a-12f5-47a7-beb2-4b81cb5d4b41\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:47.139998 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:47.139914 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:40:47.253527 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:47.253499 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:40:47.285971 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:47.285943 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8"] Jun 07 16:40:47.287115 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:40:47.287090 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2deea20a_12f5_47a7_beb2_4b81cb5d4b41.slice/crio-5afd26d68cc393831d2042b31cc3410219c3ea3ae8c926da72df02557171fd73 WatchSource:0}: Error finding container 5afd26d68cc393831d2042b31cc3410219c3ea3ae8c926da72df02557171fd73: Status 404 returned error can't find the container with id 5afd26d68cc393831d2042b31cc3410219c3ea3ae8c926da72df02557171fd73 Jun 07 16:40:48.069442 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:48.069399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" event={"ID":"2deea20a-12f5-47a7-beb2-4b81cb5d4b41","Type":"ContainerStarted","Data":"5afd26d68cc393831d2042b31cc3410219c3ea3ae8c926da72df02557171fd73"} Jun 07 16:40:52.098309 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:52.098270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" event={"ID":"2deea20a-12f5-47a7-beb2-4b81cb5d4b41","Type":"ContainerStarted","Data":"da7d799ddd4259b9b7f46dcc44a96f701d67c7fd36d783203f38a6f013687b00"} Jun 07 16:40:52.819492 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:52.819452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:40:53.233172 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:40:53.233092 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:41:01.738722 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:01.738678 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:41:02.124929 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:02.124894 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:41:13.527846 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:13.527813 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:41:14.058184 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:14.058154 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:41:14.708915 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:14.708885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:41:28.716063 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.716028 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr"] Jun 07 16:41:28.735033 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.735005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr"] Jun 07 16:41:28.735232 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.735150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.737672 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.737624 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 07 16:41:28.742081 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.742048 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:41:28.815424 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.815390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhf6x\" (UniqueName: \"kubernetes.io/projected/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-kube-api-access-rhf6x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.815575 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.815425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.815575 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.815463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.815575 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.815517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.815575 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.815541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.815575 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.815554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.916612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.916576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhf6x\" (UniqueName: \"kubernetes.io/projected/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-kube-api-access-rhf6x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.916612 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.916616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.916829 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.916710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.916829 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.916772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.916829 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.916815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.916963 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.916837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.917213 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.917191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.917292 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.917189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.917292 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.917232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.919535 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.919507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.920476 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.919712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:28.924856 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:28.924830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhf6x\" (UniqueName: \"kubernetes.io/projected/0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2-kube-api-access-rhf6x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr\" (UID: \"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:29.049077 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:29.049047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:29.185134 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:29.185105 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr"] Jun 07 16:41:29.185756 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:41:29.185728 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee78dad_d92f_4f3d_bb26_6c53eec9b1e2.slice/crio-e720c8a0b9ec8c25a86e8a2192cb53b34bfa8cbdc58d8cad6d03a7748f91a002 WatchSource:0}: Error finding container e720c8a0b9ec8c25a86e8a2192cb53b34bfa8cbdc58d8cad6d03a7748f91a002: Status 404 returned error can't find the container with id e720c8a0b9ec8c25a86e8a2192cb53b34bfa8cbdc58d8cad6d03a7748f91a002 Jun 07 16:41:29.317755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:29.317673 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" event={"ID":"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2","Type":"ContainerStarted","Data":"ae600b4f6d67a333182ac08f3ca93c02d1ba675c7845e04e5cf47033950fdf60"} Jun 07 16:41:29.317755 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:29.317724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" event={"ID":"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2","Type":"ContainerStarted","Data":"e720c8a0b9ec8c25a86e8a2192cb53b34bfa8cbdc58d8cad6d03a7748f91a002"} Jun 07 16:41:29.431325 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:29.431291 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:41:31.331085 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:31.331055 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2" containerID="ae600b4f6d67a333182ac08f3ca93c02d1ba675c7845e04e5cf47033950fdf60" exitCode=0 Jun 07 16:41:31.331454 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:31.331134 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" event={"ID":"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2","Type":"ContainerDied","Data":"ae600b4f6d67a333182ac08f3ca93c02d1ba675c7845e04e5cf47033950fdf60"} Jun 07 16:41:33.345569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:33.345534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" event={"ID":"0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2","Type":"ContainerStarted","Data":"b46a0b43758fe0a913ecdc34ad9bc7aeca4f25daad3deee57bae0d5bd431b252"} Jun 07 16:41:33.364715 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:33.364666 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" podStartSLOduration=2.479974704 podStartE2EDuration="5.364650476s" totalImagesPullingTime="1.607820795s" totalInitContainerRuntime="1.276854977s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:41:33.362818384 +0000 UTC m=+862.766167057" watchObservedRunningTime="2026-06-07 16:41:33.364650476 +0000 UTC m=+862.767999137" Jun 07 16:41:36.657622 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:36.657572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:41:37.767754 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:37.767719 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:41:39.049995 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:39.049958 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:39.050377 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:39.050020 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:39.062758 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:39.062735 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:39.391514 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:39.391430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr" Jun 07 16:41:45.419136 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:45.419050 2561 generic.go:356] "Generic (PLEG): container finished" podID="2deea20a-12f5-47a7-beb2-4b81cb5d4b41" containerID="da7d799ddd4259b9b7f46dcc44a96f701d67c7fd36d783203f38a6f013687b00" exitCode=0 Jun 07 16:41:45.419136 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:45.419122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" event={"ID":"2deea20a-12f5-47a7-beb2-4b81cb5d4b41","Type":"ContainerDied","Data":"da7d799ddd4259b9b7f46dcc44a96f701d67c7fd36d783203f38a6f013687b00"} Jun 07 16:41:46.426569 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:46.426535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" event={"ID":"2deea20a-12f5-47a7-beb2-4b81cb5d4b41","Type":"ContainerStarted","Data":"d6a3d60d5791755bb19902941eeba1e0f95d79f06dea3ce42d4a41c6a62a89ae"} Jun 07 16:41:46.448155 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:46.448102 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" podStartSLOduration=2.484214347 podStartE2EDuration="1m0.448086745s" totalImagesPullingTime="3.989017108s" totalInitContainerRuntime="53.97485529s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:40:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:41:46.446476301 +0000 UTC m=+875.849824971" watchObservedRunningTime="2026-06-07 16:41:46.448086745 +0000 UTC m=+875.851435416" Jun 07 16:41:47.140707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:47.140675 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:41:47.140870 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:47.140825 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:41:47.152576 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:47.152553 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:41:47.443104 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:41:47.443016 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8" Jun 07 16:42:11.045828 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:42:11.045744 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:42:11.056997 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:42:11.056967 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:42:40.954846 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:42:40.954791 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:42:42.147886 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:42:42.147848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:43:10.228120 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:10.228082 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:43:14.852441 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:14.852405 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:43:20.825751 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:20.825713 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:43:29.336286 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:29.336208 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:43:39.428809 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:39.428775 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:43:48.628368 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:48.628333 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:43:59.336019 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:43:59.335986 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:44:07.220352 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.220320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:07.319174 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.319142 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5886cdb686-knpxj"] Jun 07 16:44:07.319436 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.319413 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5886cdb686-knpxj" podUID="dd502007-5d2d-4b9b-b006-d458571fc9cb" containerName="manager" containerID="cri-o://9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6" gracePeriod=30 Jun 07 16:44:07.570058 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.570036 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:44:07.621651 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.621604 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktq4k\" (UniqueName: \"kubernetes.io/projected/dd502007-5d2d-4b9b-b006-d458571fc9cb-kube-api-access-ktq4k\") pod \"dd502007-5d2d-4b9b-b006-d458571fc9cb\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " Jun 07 16:44:07.621792 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.621747 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd502007-5d2d-4b9b-b006-d458571fc9cb-webhook-cert\") pod \"dd502007-5d2d-4b9b-b006-d458571fc9cb\" (UID: \"dd502007-5d2d-4b9b-b006-d458571fc9cb\") " Jun 07 16:44:07.623866 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.623836 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd502007-5d2d-4b9b-b006-d458571fc9cb-kube-api-access-ktq4k" (OuterVolumeSpecName: "kube-api-access-ktq4k") pod "dd502007-5d2d-4b9b-b006-d458571fc9cb" (UID: "dd502007-5d2d-4b9b-b006-d458571fc9cb"). InnerVolumeSpecName "kube-api-access-ktq4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:44:07.623977 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.623929 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd502007-5d2d-4b9b-b006-d458571fc9cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dd502007-5d2d-4b9b-b006-d458571fc9cb" (UID: "dd502007-5d2d-4b9b-b006-d458571fc9cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:44:07.723223 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.723201 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktq4k\" (UniqueName: \"kubernetes.io/projected/dd502007-5d2d-4b9b-b006-d458571fc9cb-kube-api-access-ktq4k\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:44:07.723223 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:07.723222 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd502007-5d2d-4b9b-b006-d458571fc9cb-webhook-cert\") on node \"ip-10-0-129-26.ec2.internal\" DevicePath \"\"" Jun 07 16:44:08.273417 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.273379 2561 generic.go:356] "Generic (PLEG): container finished" podID="dd502007-5d2d-4b9b-b006-d458571fc9cb" containerID="9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6" exitCode=0 Jun 07 16:44:08.273867 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.273440 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5886cdb686-knpxj" Jun 07 16:44:08.273867 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.273457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5886cdb686-knpxj" event={"ID":"dd502007-5d2d-4b9b-b006-d458571fc9cb","Type":"ContainerDied","Data":"9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6"} Jun 07 16:44:08.273867 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.273507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5886cdb686-knpxj" event={"ID":"dd502007-5d2d-4b9b-b006-d458571fc9cb","Type":"ContainerDied","Data":"3ada3b80a062f0a96514fa720e7bddbc042c5d17e59d4d51d6f4ca07d5a4e192"} Jun 07 16:44:08.273867 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.273535 2561 scope.go:117] "RemoveContainer" containerID="9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6" Jun 07 16:44:08.287858 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.287839 2561 scope.go:117] "RemoveContainer" containerID="9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6" Jun 07 16:44:08.288140 ip-10-0-129-26 kubenswrapper[2561]: E0607 16:44:08.288123 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6\": container with ID starting with 9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6 not found: ID does not exist" containerID="9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6" Jun 07 16:44:08.288193 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.288148 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6"} err="failed to get container status \"9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6\": rpc error: code = NotFound desc = could not find container \"9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6\": container with ID starting with 9dc9dbce3d8f9c5d296bae61c11d538b949528a39c7db3053935a0351c94d2d6 not found: ID does not exist" Jun 07 16:44:08.304650 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.304606 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5886cdb686-knpxj"] Jun 07 16:44:08.307800 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.307780 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5886cdb686-knpxj"] Jun 07 16:44:08.952081 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.952047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:08.996029 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:08.996001 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd502007-5d2d-4b9b-b006-d458571fc9cb" path="/var/lib/kubelet/pods/dd502007-5d2d-4b9b-b006-d458571fc9cb/volumes" Jun 07 16:44:17.806138 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:17.806064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:31.630953 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:31.630923 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:44:35.829515 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:35.829482 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:44:49.318280 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:49.318248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:49.414527 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:49.414497 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:49.690617 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:49.690538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:50.095907 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:50.095873 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:50.199016 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:50.198989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:44:57.916413 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:44:57.916357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:03.610427 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:03.610355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:03.670090 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:03.670066 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:12.431078 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:12.431043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:45:28.839082 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:28.839049 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:45:35.755517 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:35.755480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:35.853773 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:35.853738 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:35.953301 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:35.953268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:36.411169 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:36.411133 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:36.511698 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:36.511663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:45:59.734945 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:45:59.734914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:05.632706 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:05.632671 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:05.701662 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:05.701618 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:05.779184 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:05.779147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:05.971261 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:05.971161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:06.073405 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:06.073364 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:07.026572 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:07.026539 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:46:22.499595 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:22.499559 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:22.615299 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:22.615260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:22.733940 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:22.733910 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:24.124568 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:24.124537 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:46:25.387000 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:25.386971 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:25.489460 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:25.489431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:28.430186 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:28.430157 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:28.531395 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:28.531367 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:36.589354 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:36.589272 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:36.688682 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:36.688628 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:36.788241 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:36.788213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:36.890049 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:36.889955 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:38.126539 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:38.126508 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:46:53.327864 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:53.327806 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:53.433352 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:53.433317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:53.541647 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:53.541602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:54.123382 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:54.123339 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zz9vl"] Jun 07 16:46:59.417119 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:59.417084 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:46:59.517068 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:46:59.517035 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:47:11.098266 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:11.098241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:47:11.105128 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:11.105106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:47:12.806230 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:12.806203 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6578896ff8-qrwt6_fbe0dd1d-5418-4299-9c7f-3492e4213cee/nginx/0.log" Jun 07 16:47:13.647765 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:13.647736 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-gtp66_e700862f-c24b-4274-8a33-dcc235e44c81/copy-manifests/0.log" Jun 07 16:47:13.655132 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:13.655108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-gtp66_e700862f-c24b-4274-8a33-dcc235e44c81/manager/0.log" Jun 07 16:47:14.536889 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.536859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4_4ae47d64-00a9-448f-adf6-e49473cf65a2/util/0.log" Jun 07 16:47:14.543614 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.543593 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4_4ae47d64-00a9-448f-adf6-e49473cf65a2/pull/0.log" Jun 07 16:47:14.549543 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.549528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4_4ae47d64-00a9-448f-adf6-e49473cf65a2/extract/0.log" Jun 07 16:47:14.663414 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.663390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk_f0044289-abd1-41ea-83ae-3c2b9a973cbf/util/0.log" Jun 07 16:47:14.670435 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.670418 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk_f0044289-abd1-41ea-83ae-3c2b9a973cbf/pull/0.log" Jun 07 16:47:14.676815 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.676799 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk_f0044289-abd1-41ea-83ae-3c2b9a973cbf/extract/0.log" Jun 07 16:47:14.786307 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.786276 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4_53ddaf8b-469b-464b-b184-ffaf4e677183/util/0.log" Jun 07 16:47:14.792490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.792445 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4_53ddaf8b-469b-464b-b184-ffaf4e677183/pull/0.log" Jun 07 16:47:14.801642 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.801615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4_53ddaf8b-469b-464b-b184-ffaf4e677183/extract/0.log" Jun 07 16:47:14.907970 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.907945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57_265fba23-09d8-4486-b119-8647fb0b72a6/util/0.log" Jun 07 16:47:14.914386 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.914371 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57_265fba23-09d8-4486-b119-8647fb0b72a6/pull/0.log" Jun 07 16:47:14.920584 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:14.920565 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57_265fba23-09d8-4486-b119-8647fb0b72a6/extract/0.log" Jun 07 16:47:15.158016 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:15.157945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gfqmt_c5daff9d-0753-4423-8352-0468b881fb72/manager/0.log" Jun 07 16:47:15.266930 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:15.266906 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7c2zx_7a558bfb-65cf-4977-8a54-5faa40337644/manager/0.log" Jun 07 16:47:15.492902 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:15.492877 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ksp6j_9547a9a6-4682-41de-a1d0-ef5015992a5b/registry-server/0.log" Jun 07 16:47:15.611227 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:15.611204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rb4xx_337167f8-546f-4920-9eec-b363579d2bc2/manager/0.log" Jun 07 16:47:15.735813 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:15.735790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zz9vl_2a22fa0c-8fa2-4e20-82b8-0d1477607b58/limitador/0.log" Jun 07 16:47:16.206553 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:16.206524 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fcb7z_35d76161-769b-45fd-b122-dbff834d4c79/istio-proxy/0.log" Jun 07 16:47:17.380042 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:17.380012 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8_2deea20a-12f5-47a7-beb2-4b81cb5d4b41/storage-initializer/0.log" Jun 07 16:47:17.387707 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:17.387681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nf6w8_2deea20a-12f5-47a7-beb2-4b81cb5d4b41/main/0.log" Jun 07 16:47:17.861995 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:17.861967 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr_0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2/storage-initializer/0.log" Jun 07 16:47:17.870123 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:17.870101 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-w2ccr_0ee78dad-d92f-4f3d-bb26-6c53eec9b1e2/main/0.log" Jun 07 16:47:21.727554 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:21.727527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:47:21.829377 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:21.829343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" limit=1024 Jun 07 16:47:24.562760 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:24.562735 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t4z6n_b8443c72-de4d-4e14-a8cf-7ef18d57fd2c/global-pull-secret-syncer/0.log" Jun 07 16:47:24.644249 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:24.644221 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4j6r9_4e75d46f-5528-40c8-8331-1d417012fcde/konnectivity-agent/0.log" Jun 07 16:47:24.720932 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:24.720906 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-26.ec2.internal_a0b78fd36e18c240d772fa14def0768e/haproxy/0.log" Jun 07 16:47:29.447448 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.447417 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4_4ae47d64-00a9-448f-adf6-e49473cf65a2/extract/0.log" Jun 07 16:47:29.477618 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.477594 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4_4ae47d64-00a9-448f-adf6-e49473cf65a2/util/0.log" Jun 07 16:47:29.498474 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.498457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75994st4_4ae47d64-00a9-448f-adf6-e49473cf65a2/pull/0.log" Jun 07 16:47:29.525982 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.525964 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk_f0044289-abd1-41ea-83ae-3c2b9a973cbf/extract/0.log" Jun 07 16:47:29.548126 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.548104 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk_f0044289-abd1-41ea-83ae-3c2b9a973cbf/util/0.log" Jun 07 16:47:29.572544 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.572522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02q8qk_f0044289-abd1-41ea-83ae-3c2b9a973cbf/pull/0.log" Jun 07 16:47:29.609039 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.609022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4_53ddaf8b-469b-464b-b184-ffaf4e677183/extract/0.log" Jun 07 16:47:29.633469 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.633452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4_53ddaf8b-469b-464b-b184-ffaf4e677183/util/0.log" Jun 07 16:47:29.659868 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.659848 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73548t4_53ddaf8b-469b-464b-b184-ffaf4e677183/pull/0.log" Jun 07 16:47:29.687977 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.687954 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57_265fba23-09d8-4486-b119-8647fb0b72a6/extract/0.log" Jun 07 16:47:29.710240 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.710192 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57_265fba23-09d8-4486-b119-8647fb0b72a6/util/0.log" Jun 07 16:47:29.732490 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.732476 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qvj57_265fba23-09d8-4486-b119-8647fb0b72a6/pull/0.log" Jun 07 16:47:29.850277 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.850259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gfqmt_c5daff9d-0753-4423-8352-0468b881fb72/manager/0.log" Jun 07 16:47:29.879824 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.879801 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7c2zx_7a558bfb-65cf-4977-8a54-5faa40337644/manager/0.log" Jun 07 16:47:29.942037 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.942017 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ksp6j_9547a9a6-4682-41de-a1d0-ef5015992a5b/registry-server/0.log" Jun 07 16:47:29.980084 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:29.980035 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rb4xx_337167f8-546f-4920-9eec-b363579d2bc2/manager/0.log" Jun 07 16:47:30.002690 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:30.002672 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zz9vl_2a22fa0c-8fa2-4e20-82b8-0d1477607b58/limitador/0.log" Jun 07 16:47:31.631593 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.631561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/alertmanager/0.log" Jun 07 16:47:31.670244 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.670221 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/config-reloader/0.log" Jun 07 16:47:31.709293 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.709262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/kube-rbac-proxy-web/0.log" Jun 07 16:47:31.770475 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.770457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/kube-rbac-proxy/0.log" Jun 07 16:47:31.811130 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.811111 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/kube-rbac-proxy-metric/0.log" Jun 07 16:47:31.852164 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.852143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/prom-label-proxy/0.log" Jun 07 16:47:31.889303 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.889248 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff77358-0143-45d4-bb47-570db4ebf30d/init-config-reloader/0.log" Jun 07 16:47:31.942495 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.942473 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-q5nd8_8bf01b73-58ae-4418-be8b-c3cd0fc595ab/cluster-monitoring-operator/0.log" Jun 07 16:47:31.984668 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:31.984647 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6nh8f_c9231e5a-a75f-4edf-a1ea-277811ae4ba5/kube-state-metrics/0.log" Jun 07 16:47:32.022360 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.022344 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6nh8f_c9231e5a-a75f-4edf-a1ea-277811ae4ba5/kube-rbac-proxy-main/0.log" Jun 07 16:47:32.061098 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.061079 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6nh8f_c9231e5a-a75f-4edf-a1ea-277811ae4ba5/kube-rbac-proxy-self/0.log" Jun 07 16:47:32.361050 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.361027 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6sjh_b68e96f5-8178-47e8-a37a-522d103dd16b/node-exporter/0.log" Jun 07 16:47:32.410226 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.410203 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6sjh_b68e96f5-8178-47e8-a37a-522d103dd16b/kube-rbac-proxy/0.log" Jun 07 16:47:32.450000 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.449979 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6sjh_b68e96f5-8178-47e8-a37a-522d103dd16b/init-textfile/0.log" Jun 07 16:47:32.645316 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.645250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fz2gn_1dbceb28-b110-4972-9b4b-4330770c9b6d/kube-rbac-proxy-main/0.log" Jun 07 16:47:32.704251 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.704228 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fz2gn_1dbceb28-b110-4972-9b4b-4330770c9b6d/kube-rbac-proxy-self/0.log" Jun 07 16:47:32.753624 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.753605 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fz2gn_1dbceb28-b110-4972-9b4b-4330770c9b6d/openshift-state-metrics/0.log" Jun 07 16:47:32.995886 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:32.995824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-m57sv_88d968de-cf4d-49fb-b915-c86fa9a171ea/prometheus-operator/0.log" Jun 07 16:47:33.019752 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.019727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-m57sv_88d968de-cf4d-49fb-b915-c86fa9a171ea/kube-rbac-proxy/0.log" Jun 07 16:47:33.047397 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.047374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-c84js_56f2293d-bd50-4152-9f3b-a9010599a439/prometheus-operator-admission-webhook/0.log" Jun 07 16:47:33.079690 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.079665 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79dc86655b-vnc6r_2cc4630b-b536-4152-b1b0-be89fcb8eedf/telemeter-client/0.log" Jun 07 16:47:33.100260 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.100231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79dc86655b-vnc6r_2cc4630b-b536-4152-b1b0-be89fcb8eedf/reload/0.log" Jun 07 16:47:33.122164 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.122145 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79dc86655b-vnc6r_2cc4630b-b536-4152-b1b0-be89fcb8eedf/kube-rbac-proxy/0.log" Jun 07 16:47:33.158431 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.158412 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/thanos-query/0.log" Jun 07 16:47:33.179549 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.179530 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy-web/0.log" Jun 07 16:47:33.203821 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.203797 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy/0.log" Jun 07 16:47:33.224719 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.224699 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/prom-label-proxy/0.log" Jun 07 16:47:33.248076 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.248028 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy-rules/0.log" Jun 07 16:47:33.269676 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:33.269625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64445f44f4-4nlp2_c9ef99cf-fd11-4699-bbee-511f6b2204bb/kube-rbac-proxy-metrics/0.log" Jun 07 16:47:35.009182 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.009145 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/1.log" Jun 07 16:47:35.014993 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.014961 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-xn4mm_6219ca31-7765-4664-ba46-c6bdabedc5f3/console-operator/2.log" Jun 07 16:47:35.240321 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.240279 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn"] Jun 07 16:47:35.240918 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.240871 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd502007-5d2d-4b9b-b006-d458571fc9cb" containerName="manager" Jun 07 16:47:35.240918 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.240896 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd502007-5d2d-4b9b-b006-d458571fc9cb" containerName="manager" Jun 07 16:47:35.241116 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.241033 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd502007-5d2d-4b9b-b006-d458571fc9cb" containerName="manager" Jun 07 16:47:35.244306 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.244285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.246908 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.246887 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nhgnq\"/\"openshift-service-ca.crt\"" Jun 07 16:47:35.246999 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.246962 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nhgnq\"/\"default-dockercfg-2z7nd\"" Jun 07 16:47:35.246999 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.246886 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nhgnq\"/\"kube-root-ca.crt\"" Jun 07 16:47:35.253195 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.253170 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn"] Jun 07 16:47:35.311687 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.311595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-proc\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.311687 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.311656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-lib-modules\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.311855 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.311698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-sys\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.311855 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.311779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmtc\" (UniqueName: \"kubernetes.io/projected/bb3108d7-6ac5-49ca-9ea9-53ead863a715-kube-api-access-tpmtc\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.311855 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.311812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-podres\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmtc\" (UniqueName: \"kubernetes.io/projected/bb3108d7-6ac5-49ca-9ea9-53ead863a715-kube-api-access-tpmtc\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413083 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-podres\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413271 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-podres\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-proc\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-lib-modules\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-proc\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413344 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-sys\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-lib-modules\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.413471 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.413432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb3108d7-6ac5-49ca-9ea9-53ead863a715-sys\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.421168 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.421142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmtc\" (UniqueName: \"kubernetes.io/projected/bb3108d7-6ac5-49ca-9ea9-53ead863a715-kube-api-access-tpmtc\") pod \"perf-node-gather-daemonset-4g7nn\" (UID: \"bb3108d7-6ac5-49ca-9ea9-53ead863a715\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.555094 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.555062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:35.568551 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.568529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5675bfb7c8-ltgtr_ba6cbf84-8eda-4496-9719-05a46d98a598/console/0.log" Jun 07 16:47:35.690660 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:35.687966 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn"] Jun 07 16:47:35.692993 ip-10-0-129-26 kubenswrapper[2561]: W0607 16:47:35.692966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb3108d7_6ac5_49ca_9ea9_53ead863a715.slice/crio-9c9c580d2b01f9641e85664d70899745b2f1b7d6d778a47ff8bc829828946d3d WatchSource:0}: Error finding container 9c9c580d2b01f9641e85664d70899745b2f1b7d6d778a47ff8bc829828946d3d: Status 404 returned error can't find the container with id 9c9c580d2b01f9641e85664d70899745b2f1b7d6d778a47ff8bc829828946d3d Jun 07 16:47:36.318705 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:36.318677 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-zw5mz_22188524-497c-42cb-85c3-480ae1b6ab00/volume-data-source-validator/0.log" Jun 07 16:47:36.515643 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:36.515600 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" event={"ID":"bb3108d7-6ac5-49ca-9ea9-53ead863a715","Type":"ContainerStarted","Data":"a15eee6c84acc6ed4dc8fa7b719984f321bb94f023fdab783621883bf54775af"} Jun 07 16:47:36.515791 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:36.515676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" event={"ID":"bb3108d7-6ac5-49ca-9ea9-53ead863a715","Type":"ContainerStarted","Data":"9c9c580d2b01f9641e85664d70899745b2f1b7d6d778a47ff8bc829828946d3d"} Jun 07 16:47:36.515840 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:36.515812 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:36.533676 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:36.533618 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" podStartSLOduration=1.5336057520000002 podStartE2EDuration="1.533605752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:47:36.530856245 +0000 UTC m=+1225.934204916" watchObservedRunningTime="2026-06-07 16:47:36.533605752 +0000 UTC m=+1225.936954421" Jun 07 16:47:37.474781 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:37.474752 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlb9x_452f1216-275f-4bf0-ba3f-5b713d478237/dns/0.log" Jun 07 16:47:37.496540 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:37.496520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlb9x_452f1216-275f-4bf0-ba3f-5b713d478237/kube-rbac-proxy/0.log" Jun 07 16:47:37.520721 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:37.520695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fjhsn_42d5ecfd-006a-4b61-accc-df6012082fe4/dns-node-resolver/0.log" Jun 07 16:47:38.149752 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:38.149710 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf7mk_75deb2a9-94d0-47db-8a2b-2573142d1793/node-ca/0.log" Jun 07 16:47:39.067807 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:39.067782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fcb7z_35d76161-769b-45fd-b122-dbff834d4c79/istio-proxy/0.log" Jun 07 16:47:39.944885 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:39.944859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b52tw_17513ad6-d53b-4329-92db-436f2f32d90d/serve-healthcheck-canary/0.log" Jun 07 16:47:40.646804 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:40.646772 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvx7r_715117a2-affb-4283-9060-15807dfff757/kube-rbac-proxy/0.log" Jun 07 16:47:40.671806 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:40.671778 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvx7r_715117a2-affb-4283-9060-15807dfff757/exporter/0.log" Jun 07 16:47:40.698147 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:40.698109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvx7r_715117a2-affb-4283-9060-15807dfff757/extractor/0.log" Jun 07 16:47:42.532713 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:42.532689 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-4g7nn" Jun 07 16:47:42.891323 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:42.891233 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6578896ff8-qrwt6_fbe0dd1d-5418-4299-9c7f-3492e4213cee/nginx/0.log" Jun 07 16:47:43.224736 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:43.224628 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-gtp66_e700862f-c24b-4274-8a33-dcc235e44c81/manager/0.log" Jun 07 16:47:43.244401 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:43.244376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-gtp66_e700862f-c24b-4274-8a33-dcc235e44c81/copy-manifests/0.log" Jun 07 16:47:44.999517 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:44.999490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b9d9f97f8-4l9xc_eb59d10b-0abd-4c4c-b8b3-cc387ce782a2/manager/0.log" Jun 07 16:47:45.053794 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:45.053774 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lz8w5_ef37dc8e-caf6-4100-b4b5-f9e6edd7282c/openshift-lws-operator/0.log" Jun 07 16:47:49.534604 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:49.534574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fcb7z_35d76161-769b-45fd-b122-dbff834d4c79/istio-proxy/0.log" Jun 07 16:47:50.164441 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:50.164414 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-szqj9_f15d6965-b040-4ae8-8f15-616d7a0d12ec/migrator/0.log" Jun 07 16:47:50.191583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:50.191557 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-szqj9_f15d6965-b040-4ae8-8f15-616d7a0d12ec/graceful-termination/0.log" Jun 07 16:47:50.806655 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:50.806601 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fcb7z_35d76161-769b-45fd-b122-dbff834d4c79/istio-proxy/0.log" Jun 07 16:47:51.799669 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.799624 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/kube-multus-additional-cni-plugins/0.log" Jun 07 16:47:51.819897 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.819873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/egress-router-binary-copy/0.log" Jun 07 16:47:51.840519 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.840500 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/cni-plugins/0.log" Jun 07 16:47:51.862562 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.862540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/bond-cni-plugin/0.log" Jun 07 16:47:51.883983 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.883962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/routeoverride-cni/0.log" Jun 07 16:47:51.904583 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.904565 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/whereabouts-cni-bincopy/0.log" Jun 07 16:47:51.924422 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:51.924405 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2wqk7_83915597-5417-4f08-b808-4faa9821ede0/whereabouts-cni/0.log" Jun 07 16:47:52.285333 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:52.285309 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lftfj_f258ff70-29a5-4705-9d44-4b57051cd060/kube-multus/0.log" Jun 07 16:47:52.431107 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:52.431083 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hs6wc_dfea8106-9ac0-4427-a1f1-d94b5776d1ab/network-metrics-daemon/0.log" Jun 07 16:47:52.484210 ip-10-0-129-26 kubenswrapper[2561]: I0607 16:47:52.484185 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hs6wc_dfea8106-9ac0-4427-a1f1-d94b5776d1ab/kube-rbac-proxy/0.log"