Jun 13 01:58:07.621131 ip-10-0-134-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 01:58:07.621143 ip-10-0-134-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 01:58:07.621150 ip-10-0-134-133 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 01:58:07.621383 ip-10-0-134-133 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 01:58:17.679593 ip-10-0-134-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 01:58:17.679608 ip-10-0-134-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5a17aa5e72d341f4a800b72c51c36c71 -- Jun 13 02:00:33.959081 ip-10-0-134-133 systemd[1]: Starting Kubernetes Kubelet... Jun 13 02:00:34.257647 ip-10-0-134-133 kubenswrapper[2546]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:34.257647 ip-10-0-134-133 kubenswrapper[2546]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 02:00:34.257647 ip-10-0-134-133 kubenswrapper[2546]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:34.257647 ip-10-0-134-133 kubenswrapper[2546]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 02:00:34.257647 ip-10-0-134-133 kubenswrapper[2546]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:34.258309 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.258198 2546 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 02:00:34.262030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262013 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:34.262030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262030 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262036 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262040 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262044 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262047 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262049 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262052 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262055 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262058 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262061 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262064 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262067 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262069 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262072 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262074 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262077 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262079 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262082 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262084 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262088 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:34.262100 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262090 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262093 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262095 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262098 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262100 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262103 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262106 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262109 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262112 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262114 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262117 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262120 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262122 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262125 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262128 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262131 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262134 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262140 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262143 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262145 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:34.262574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262148 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262150 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262153 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262155 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262157 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262160 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262163 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262165 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262168 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262170 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262172 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262175 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262178 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262181 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262184 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262187 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262189 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262192 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262195 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262198 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:34.263110 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262200 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262207 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262209 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262212 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262214 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262217 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262220 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262222 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262225 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262227 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262230 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262232 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262235 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262237 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262239 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262242 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262244 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262247 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262251 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262254 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:34.263596 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262257 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262261 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262265 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262267 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262270 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262273 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262278 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262281 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262284 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262287 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262290 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262292 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262295 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262298 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262300 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262303 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262305 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.262308 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263027 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:34.264094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263034 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263037 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263041 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263044 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263047 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263049 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263052 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263055 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263057 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263060 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263062 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263065 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263068 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263071 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263074 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263077 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263079 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263082 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263085 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:34.264553 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263098 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263103 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263107 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263111 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263115 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263118 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263121 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263124 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263127 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263129 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263132 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263135 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263138 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263141 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263143 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263146 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263148 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263151 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263155 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263157 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:34.265037 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263160 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263162 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263165 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263167 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263170 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263173 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263175 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263178 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263180 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263183 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263185 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263188 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263191 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263194 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263197 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263199 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263202 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263204 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263207 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263209 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:34.265516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263212 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263214 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263217 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263219 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263222 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263224 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263227 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263229 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263232 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263234 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263237 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263239 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263242 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263246 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263249 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263253 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263256 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263258 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263261 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:34.266016 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263263 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263266 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263268 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263272 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263275 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263278 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263280 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263283 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263286 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263289 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263291 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263293 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263297 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263299 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263302 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263304 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263307 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263309 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263312 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:34.266484 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263314 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263676 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263680 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263683 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263685 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263688 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263691 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263694 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263696 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263699 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263702 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263704 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263707 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263709 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263712 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263714 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263717 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263720 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263722 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263725 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:34.267010 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263728 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263731 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263733 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263736 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263738 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263741 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263744 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263747 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263749 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263751 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263754 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263756 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263759 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263762 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263764 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263767 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263769 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263773 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263797 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:34.267516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263802 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263806 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263808 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263811 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263814 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263817 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263821 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263824 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263827 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263830 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263833 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263836 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263838 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263841 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263844 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263846 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263849 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263852 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263854 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263857 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:34.267994 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263860 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263862 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263865 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263867 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263870 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263872 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263875 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263877 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263880 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263882 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263885 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263887 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263890 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263892 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263895 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263898 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263900 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263903 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263905 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263908 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:34.268516 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263910 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263914 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263916 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263919 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263922 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263924 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263928 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263932 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263935 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263937 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263940 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263943 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263945 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263947 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263950 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263952 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263955 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263957 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263960 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:34.269030 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263962 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.263965 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264029 2546 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264036 2546 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264042 2546 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264048 2546 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264057 2546 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264062 2546 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264068 2546 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264074 2546 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264077 2546 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264080 2546 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264083 2546 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264087 2546 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264090 2546 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264094 2546 flags.go:64] FLAG: --cgroup-root="" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264097 2546 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264100 2546 flags.go:64] FLAG: --client-ca-file="" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264103 2546 flags.go:64] FLAG: --cloud-provider="external" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264106 2546 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264110 2546 flags.go:64] FLAG: --cluster-domain="" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264114 2546 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264117 2546 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264123 2546 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 02:00:34.269476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264126 2546 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264129 2546 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264133 2546 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264136 2546 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264139 2546 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264142 2546 flags.go:64] FLAG: --contention-profiling="false" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264145 2546 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264148 2546 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264151 2546 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264154 2546 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264158 2546 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264161 2546 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264163 2546 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264166 2546 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264170 2546 flags.go:64] FLAG: --enable-server="true" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264173 2546 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264177 2546 flags.go:64] FLAG: --event-burst="100" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264180 2546 flags.go:64] FLAG: --event-qps="50" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264183 2546 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264187 2546 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264189 2546 flags.go:64] FLAG: --eviction-hard="" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264193 2546 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264196 2546 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264199 2546 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264202 2546 flags.go:64] FLAG: --eviction-soft="" Jun 13 02:00:34.270097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264205 2546 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264208 2546 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264210 2546 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264213 2546 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264216 2546 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264220 2546 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264224 2546 flags.go:64] FLAG: --feature-gates="" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264227 2546 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264230 2546 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264233 2546 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264236 2546 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264239 2546 flags.go:64] FLAG: --healthz-port="10248" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264246 2546 flags.go:64] FLAG: --help="false" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264249 2546 flags.go:64] FLAG: --hostname-override="ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264252 2546 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264255 2546 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264258 2546 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264261 2546 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264265 2546 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264267 2546 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264270 2546 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264273 2546 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264276 2546 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 02:00:34.271005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264279 2546 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264282 2546 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264285 2546 flags.go:64] FLAG: --kube-reserved="" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264288 2546 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264291 2546 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264294 2546 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264296 2546 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264299 2546 flags.go:64] FLAG: --lock-file="" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264302 2546 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264305 2546 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264308 2546 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264313 2546 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264316 2546 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264319 2546 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264322 2546 flags.go:64] FLAG: --logging-format="text" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264327 2546 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264330 2546 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264333 2546 flags.go:64] FLAG: --manifest-url="" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264336 2546 flags.go:64] FLAG: --manifest-url-header="" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264340 2546 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264343 2546 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264348 2546 flags.go:64] FLAG: --max-pods="110" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264351 2546 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264354 2546 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264357 2546 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 02:00:34.271971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264360 2546 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264363 2546 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264365 2546 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264369 2546 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264376 2546 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264379 2546 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264382 2546 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264384 2546 flags.go:64] FLAG: --pod-cidr="" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264387 2546 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264393 2546 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264396 2546 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264399 2546 flags.go:64] FLAG: --pods-per-core="0" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264402 2546 flags.go:64] FLAG: --port="10250" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264405 2546 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264408 2546 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-023d33fa97f1a3e19" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264411 2546 flags.go:64] FLAG: --qos-reserved="" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264414 2546 flags.go:64] FLAG: --read-only-port="10255" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264417 2546 flags.go:64] FLAG: --register-node="true" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264420 2546 flags.go:64] FLAG: --register-with-taints="" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264423 2546 flags.go:64] FLAG: --registry-burst="10" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264426 2546 flags.go:64] FLAG: --registry-qps="5" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264429 2546 flags.go:64] FLAG: --reserved-cpus="" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264433 2546 flags.go:64] FLAG: --reserved-memory="" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264437 2546 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264440 2546 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 02:00:34.272657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264443 2546 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264446 2546 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264449 2546 flags.go:64] FLAG: --runonce="false" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264451 2546 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264456 2546 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264459 2546 flags.go:64] FLAG: --seccomp-default="false" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264461 2546 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264464 2546 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264467 2546 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264471 2546 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264474 2546 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264477 2546 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264479 2546 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264482 2546 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264485 2546 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264488 2546 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264491 2546 flags.go:64] FLAG: --system-cgroups="" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264494 2546 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264499 2546 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264501 2546 flags.go:64] FLAG: --tls-cert-file="" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264504 2546 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264508 2546 flags.go:64] FLAG: --tls-min-version="" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264511 2546 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264513 2546 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264516 2546 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 02:00:34.273296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264519 2546 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264522 2546 flags.go:64] FLAG: --v="2" Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264526 2546 flags.go:64] FLAG: --version="false" Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264530 2546 flags.go:64] FLAG: --vmodule="" Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264537 2546 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.264541 2546 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264652 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264656 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264659 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264663 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264665 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264671 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264674 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264677 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264679 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264682 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264685 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264688 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264690 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264693 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264695 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:34.273945 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264698 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264700 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264703 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264705 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264707 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264710 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264712 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264715 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264717 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264720 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264722 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264725 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264728 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264730 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264734 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264738 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264741 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264743 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264746 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264749 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:34.274463 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264751 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264754 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264759 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264763 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264766 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264769 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264772 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264775 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264790 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264793 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264796 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264799 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264802 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264805 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264808 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264811 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264813 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264816 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264819 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:34.274974 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264821 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264824 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264826 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264829 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264831 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264834 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264836 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264839 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264843 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264845 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264848 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264851 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264853 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264856 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264859 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264864 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264866 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264869 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264871 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264874 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:34.275445 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264876 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264879 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264881 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264884 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264886 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264889 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264891 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264893 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264896 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264898 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264901 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264904 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264906 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264909 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264911 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264914 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264917 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264919 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264921 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:34.275951 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264925 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264930 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264932 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264935 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264938 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.264941 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.265547 2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.273267 2546 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.273282 2546 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.273295 2546 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.273301 2546 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273356 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273360 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273364 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273367 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:34.276410 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273370 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273373 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273376 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273379 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273382 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273385 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273388 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273391 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273394 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273397 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273400 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273403 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273406 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273408 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273411 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273413 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273416 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273419 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273422 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:34.276867 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273424 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273429 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273433 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273436 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273439 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273441 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273445 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273448 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273451 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273454 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273457 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273460 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273463 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273466 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273469 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273472 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273475 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273477 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273480 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:34.277317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273482 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273485 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273488 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273490 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273493 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273496 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273499 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273501 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273504 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273508 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273512 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273515 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273518 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273521 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273523 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273526 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273529 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273532 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273534 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:34.277829 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273537 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273540 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273543 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273545 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273548 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273550 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273553 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273555 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273558 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273562 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273565 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273568 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273571 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273573 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273576 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273579 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273582 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273584 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273587 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:34.278368 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273590 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273593 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273596 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273598 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273601 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273603 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273606 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273609 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273611 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273614 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273616 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273619 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273621 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273624 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273627 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273630 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273632 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273635 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:34.278928 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273638 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.273642 2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273750 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273755 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273758 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273762 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273765 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273769 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273773 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273776 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273794 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273798 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273801 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273804 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273808 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:34.279411 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273810 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273813 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273816 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273818 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273822 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273825 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273828 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273830 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273833 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273835 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273838 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273840 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273843 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273845 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273848 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273851 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273854 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273856 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273859 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:34.279992 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273861 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273864 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273867 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273869 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273871 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273874 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273877 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273879 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273883 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273886 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273889 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273892 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273894 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273898 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273900 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273903 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273906 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273908 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273911 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273914 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:34.280765 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273916 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273919 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273922 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273924 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273927 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273930 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273932 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273935 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273937 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273940 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273943 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273945 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273948 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273951 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273953 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273956 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273959 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273961 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273964 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273966 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:34.281317 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273969 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273971 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273974 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273976 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273979 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273983 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273986 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273988 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273991 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273994 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273996 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.273999 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274002 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274004 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274007 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274009 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274012 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274014 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274017 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:34.282112 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274020 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274022 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274025 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274027 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274030 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274033 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274035 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:34.274038 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.274043 2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.274188 2546 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.277558 2546 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.278657 2546 server.go:1019] "Starting client certificate rotation" Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.278769 2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 02:00:34.283200 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.278834 2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 02:00:34.283533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.280559 2546 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 02:00:34.283533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.281826 2546 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 02:00:34.292465 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.292449 2546 log.go:25] "Validated CRI v1 runtime API" Jun 13 02:00:34.296797 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.296766 2546 log.go:25] "Validated CRI v1 image API" Jun 13 02:00:34.297519 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.297501 2546 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 02:00:34.299383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.299364 2546 fs.go:135] Filesystem UUIDs: map[10815a14-d375-4ced-986c-b2d6eaa2368e:/dev/nvme0n1p4 37c74978-2f42-4af2-af62-634b6c9230ac:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 13 02:00:34.299453 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.299382 2546 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 02:00:34.304699 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.304579 2546 manager.go:216] Machine: {Timestamp:2026-06-13 02:00:34.303234082 +0000 UTC m=+0.250918993 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124774 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e4a4f79ef5f0fed656f02bd1435fd SystemUUID:ec2e4a4f-79ef-5f0f-ed65-6f02bd1435fd BootID:5a17aa5e-72d3-41f4-a800-b72c51c36c71 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:1f:19:fb:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:1f:19:fb:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:26:97:98:c3:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 02:00:34.304699 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.304690 2546 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 02:00:34.304875 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.304863 2546 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 02:00:34.307311 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307288 2546 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 02:00:34.307386 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307352 2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 02:00:34.307484 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307314 2546 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 02:00:34.307947 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307935 2546 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 02:00:34.308006 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307953 2546 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 02:00:34.308006 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307964 2546 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 02:00:34.308006 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.307985 2546 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 02:00:34.309068 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.309056 2546 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 02:00:34.312688 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312675 2546 state_mem.go:36] "Initialized new in-memory state store" Jun 13 02:00:34.312842 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312831 2546 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 02:00:34.312900 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312870 2546 kubelet.go:486] "Attempting to sync node with API server" Jun 13 02:00:34.312900 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312884 2546 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 02:00:34.312994 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312903 2546 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 02:00:34.312994 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312917 2546 kubelet.go:398] "Adding apiserver pod source" Jun 13 02:00:34.312994 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.312933 2546 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 02:00:34.313324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.313311 2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 02:00:34.313384 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.313334 2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 02:00:34.315038 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.315021 2546 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 02:00:34.316387 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316374 2546 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 02:00:34.316437 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316404 2546 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 02:00:34.316578 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316568 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 02:00:34.316608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316584 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 02:00:34.316608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316591 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 02:00:34.316608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316597 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 02:00:34.316608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316605 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 02:00:34.316732 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316612 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 02:00:34.316982 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316973 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 02:00:34.316982 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316982 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 02:00:34.317044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316989 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 02:00:34.317044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.316994 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 02:00:34.317044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.317002 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 02:00:34.317044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.317010 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 02:00:34.318004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.317995 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 02:00:34.318004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.318004 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 02:00:34.321157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.321144 2546 server.go:1268] "Started kubelet" Jun 13 02:00:34.321270 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.321242 2546 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 02:00:34.321333 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.321244 2546 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 02:00:34.321333 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.321314 2546 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 02:00:34.322057 ip-10-0-134-133 systemd[1]: Started Kubernetes Kubelet. Jun 13 02:00:34.322700 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.322679 2546 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 02:00:34.323324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.323303 2546 server.go:310] "Adding debug handlers to kubelet server" Jun 13 02:00:34.324134 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.324106 2546 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 02:00:34.324657 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.324631 2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 02:00:34.324657 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.324631 2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 02:00:34.327740 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.326927 2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-133.ec2.internal.18b8817ed26a1f43 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-133.ec2.internal,UID:ip-10-0-134-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-133.ec2.internal,},FirstTimestamp:2026-06-13 02:00:34.321063747 +0000 UTC m=+0.268748659,LastTimestamp:2026-06-13 02:00:34.321063747 +0000 UTC m=+0.268748659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-133.ec2.internal,}" Jun 13 02:00:34.327863 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.327767 2546 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 02:00:34.327863 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.327800 2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 02:00:34.327998 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.327982 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.328048 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.327978 2546 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 02:00:34.328306 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.328288 2546 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 02:00:34.328363 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.328310 2546 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 02:00:34.328421 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.328404 2546 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 02:00:34.328609 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.328511 2546 reconstruct.go:97] "Volume reconstruction finished" Jun 13 02:00:34.328609 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.328524 2546 reconciler.go:29] "Reconciler: start to sync state" Jun 13 02:00:34.329359 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329343 2546 factory.go:55] Registering systemd factory Jun 13 02:00:34.329359 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329358 2546 factory.go:223] Registration of the systemd container factory successfully Jun 13 02:00:34.329550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329536 2546 factory.go:153] Registering CRI-O factory Jun 13 02:00:34.329550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329550 2546 factory.go:223] Registration of the crio container factory successfully Jun 13 02:00:34.329644 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329596 2546 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 02:00:34.329644 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329616 2546 factory.go:103] Registering Raw factory Jun 13 02:00:34.329644 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.329628 2546 manager.go:1196] Started watching for new ooms in manager Jun 13 02:00:34.330059 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.330046 2546 manager.go:349] Starting recovery of all containers Jun 13 02:00:34.335555 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.335528 2546 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 02:00:34.335679 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.335557 2546 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 02:00:34.341074 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.341055 2546 manager.go:354] Recovery completed Jun 13 02:00:34.345112 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.345097 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.347182 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347164 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.347260 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347198 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.347260 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347212 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.347696 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347672 2546 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 02:00:34.347696 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347680 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.347696 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347685 2546 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 02:00:34.347696 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.347699 2546 state_mem.go:36] "Initialized new in-memory state store" Jun 13 02:00:34.348618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.348601 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.348682 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.348628 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.348682 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.348637 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.349219 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.349143 2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-133.ec2.internal.18b8817ed3f8a8d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-133.ec2.internal,UID:ip-10-0-134-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-133.ec2.internal,},FirstTimestamp:2026-06-13 02:00:34.34718229 +0000 UTC m=+0.294867213,LastTimestamp:2026-06-13 02:00:34.34718229 +0000 UTC m=+0.294867213,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-133.ec2.internal,}" Jun 13 02:00:34.349930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.349919 2546 policy_none.go:49] "None policy: Start" Jun 13 02:00:34.349972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.349935 2546 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 02:00:34.349972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.349947 2546 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 02:00:34.351975 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.351964 2546 policy_none.go:47] "Start" Jun 13 02:00:34.354870 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.354852 2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2x7w" Jun 13 02:00:34.358152 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.358097 2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-133.ec2.internal.18b8817ed3f90399 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-133.ec2.internal,UID:ip-10-0-134-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-133.ec2.internal,},FirstTimestamp:2026-06-13 02:00:34.347205529 +0000 UTC m=+0.294890443,LastTimestamp:2026-06-13 02:00:34.347205529 +0000 UTC m=+0.294890443,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-133.ec2.internal,}" Jun 13 02:00:34.360741 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.360725 2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2x7w" Jun 13 02:00:34.384451 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.384434 2546 manager.go:337] "Starting Device Plugin manager" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.384473 2546 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.384487 2546 server.go:87] "Starting device plugin registration server" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.384733 2546 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.384743 2546 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.384908 2546 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.385011 2546 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.385022 2546 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.385607 2546 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.385655 2546 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.388996 2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.390168 2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.390202 2546 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.390219 2546 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.390274 2546 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 02:00:34.405398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.392230 2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:34.485858 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.485820 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.486776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.486756 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.486899 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.486813 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.486899 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.486828 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.486899 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.486861 2546 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.491109 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.491085 2546 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal"] Jun 13 02:00:34.491181 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.491172 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.492422 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.492398 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.492511 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.492429 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.492511 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.492443 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.494821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.494807 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.494906 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.494878 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.494951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.494914 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.495499 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495476 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.495580 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495507 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.495580 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495488 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.495580 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495517 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.495580 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495537 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.495580 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495549 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.495963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.495951 2546 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.496003 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.495970 2546 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-133.ec2.internal\": node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.497876 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.497853 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.497975 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.497884 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:34.498582 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.498564 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:34.498665 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.498593 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:34.498665 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.498602 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:34.522220 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.522197 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.523148 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.522875 2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-133.ec2.internal\" not found" node="ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.527795 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.527765 2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-133.ec2.internal\" not found" node="ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.623170 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.623104 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.629409 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.629391 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19323d6ad4effe9e8837a575961bbbea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal\" (UID: \"19323d6ad4effe9e8837a575961bbbea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.629464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.629419 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19323d6ad4effe9e8837a575961bbbea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal\" (UID: \"19323d6ad4effe9e8837a575961bbbea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.629464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.629436 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/97c5f5bba509447a5b7bb6659ffef353-config\") pod \"kube-apiserver-proxy-ip-10-0-134-133.ec2.internal\" (UID: \"97c5f5bba509447a5b7bb6659ffef353\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.723560 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.723522 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.729821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.729798 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19323d6ad4effe9e8837a575961bbbea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal\" (UID: \"19323d6ad4effe9e8837a575961bbbea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.729867 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.729828 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19323d6ad4effe9e8837a575961bbbea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal\" (UID: \"19323d6ad4effe9e8837a575961bbbea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.729867 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.729847 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/97c5f5bba509447a5b7bb6659ffef353-config\") pod \"kube-apiserver-proxy-ip-10-0-134-133.ec2.internal\" (UID: \"97c5f5bba509447a5b7bb6659ffef353\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.729930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.729899 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19323d6ad4effe9e8837a575961bbbea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal\" (UID: \"19323d6ad4effe9e8837a575961bbbea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.729959 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.729891 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/97c5f5bba509447a5b7bb6659ffef353-config\") pod \"kube-apiserver-proxy-ip-10-0-134-133.ec2.internal\" (UID: \"97c5f5bba509447a5b7bb6659ffef353\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.729959 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.729901 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19323d6ad4effe9e8837a575961bbbea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal\" (UID: \"19323d6ad4effe9e8837a575961bbbea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.824265 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.824224 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:34.826383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.826363 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.830697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:34.830603 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" Jun 13 02:00:34.924401 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:34.924313 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.024847 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:35.024804 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.125314 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:35.125285 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.225929 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:35.225835 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.278304 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.278272 2546 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 02:00:35.278943 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.278420 2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 02:00:35.326347 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:35.326321 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.365581 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.365530 2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 01:55:34 +0000 UTC" deadline="2028-01-17 14:31:08.226353434 +0000 UTC" Jun 13 02:00:35.365581 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.365571 2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14004h30m32.860785069s" Jun 13 02:00:35.427456 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:35.427428 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.431330 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.431308 2546 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:35.443548 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.443403 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:35.444866 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.444849 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:35.444937 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.444888 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:35.444937 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.444906 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:35.510416 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:35.510388 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19323d6ad4effe9e8837a575961bbbea.slice/crio-4e2ac23759c1ba7c0ad6d07ce84fcf3387e95e1b24e72325f52ab8deb78ad3d1 WatchSource:0}: Error finding container 4e2ac23759c1ba7c0ad6d07ce84fcf3387e95e1b24e72325f52ab8deb78ad3d1: Status 404 returned error can't find the container with id 4e2ac23759c1ba7c0ad6d07ce84fcf3387e95e1b24e72325f52ab8deb78ad3d1 Jun 13 02:00:35.518044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.518027 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:00:35.523285 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:35.523264 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c5f5bba509447a5b7bb6659ffef353.slice/crio-efa999e9e5307d756c91bfc4f6511c4e4e677d45f7ec3c0123cd94cda97e7a04 WatchSource:0}: Error finding container efa999e9e5307d756c91bfc4f6511c4e4e677d45f7ec3c0123cd94cda97e7a04: Status 404 returned error can't find the container with id efa999e9e5307d756c91bfc4f6511c4e4e677d45f7ec3c0123cd94cda97e7a04 Jun 13 02:00:35.528296 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:35.528277 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-133.ec2.internal\" not found" Jun 13 02:00:35.532431 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.532416 2546 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:35.601555 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.601529 2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:35.628539 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.628514 2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" Jun 13 02:00:35.639523 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.639504 2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 02:00:35.640284 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.640273 2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" Jun 13 02:00:35.648541 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:35.648522 2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 02:00:36.314268 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.314231 2546 apiserver.go:52] "Watching apiserver" Jun 13 02:00:36.321246 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.321222 2546 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 02:00:36.321647 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.321615 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal","openshift-multus/multus-cpflc","openshift-network-diagnostics/network-check-target-gd9m8","kube-system/global-pull-secret-syncer-fdj28","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b","openshift-multus/multus-additional-cni-plugins-fbdwg","openshift-multus/network-metrics-daemon-dv4cc","openshift-network-operator/iptables-alerter-xgfzt","openshift-ovn-kubernetes/ovnkube-node-rs9pf","kube-system/konnectivity-agent-pdlkg","kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rgxld","openshift-dns/node-resolver-bhs2f","openshift-image-registry/node-ca-nbmxr"] Jun 13 02:00:36.324113 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.324093 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.324213 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.324188 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:36.326603 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.326576 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.328759 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.328738 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dk2b6\"" Jun 13 02:00:36.329081 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.329064 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.329150 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.329088 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:36.329223 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.329159 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.331655 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.329064 2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 02:00:36.331655 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.329145 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:36.332415 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.332257 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.332415 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.332371 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:36.335626 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.335396 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337480 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337717 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337756 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6x9x\" (UniqueName: \"kubernetes.io/projected/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-kube-api-access-g6x9x\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337796 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40eab1e5-112f-4d65-8fe3-6d5b2105d482-hosts-file\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337806 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s6kg\"" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337820 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40eab1e5-112f-4d65-8fe3-6d5b2105d482-tmp-dir\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337844 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337866 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-dbus\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337894 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337917 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56g2q\" (UniqueName: \"kubernetes.io/projected/40eab1e5-112f-4d65-8fe3-6d5b2105d482-kube-api-access-56g2q\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.337943 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-kubelet-config\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.338024 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.338165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.338024 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.339922 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.339632 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.340531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.340510 2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 02:00:36.342226 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342206 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 02:00:36.342347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342327 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 02:00:36.342448 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342395 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 02:00:36.342448 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342269 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.342566 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342285 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.342566 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342213 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdgbc\"" Jun 13 02:00:36.342734 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.342717 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.344878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.344863 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.345052 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345034 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 02:00:36.345993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345130 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 02:00:36.345993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345336 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.345993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345546 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.345993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345615 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 02:00:36.345993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345743 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z72bg\"" Jun 13 02:00:36.345993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.345830 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 02:00:36.347625 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.347209 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.348357 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.347981 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.348357 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.348166 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-whkfq\"" Jun 13 02:00:36.348357 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.348219 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 02:00:36.348357 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.348329 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.349157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.349141 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 02:00:36.349333 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.349314 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x765p\"" Jun 13 02:00:36.349638 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.349598 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.351635 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.351617 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 02:00:36.351990 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.351965 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 02:00:36.352079 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.351968 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5nprx\"" Jun 13 02:00:36.352398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.352379 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.354724 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.354595 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 02:00:36.354724 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.354648 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tdmj2\"" Jun 13 02:00:36.354871 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.354835 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.355117 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.355098 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.355393 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.355375 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.357363 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.357329 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:00:36.357495 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.357476 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 02:00:36.357584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.357567 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ml7hz\"" Jun 13 02:00:36.361304 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.361255 2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dh4vr" Jun 13 02:00:36.368618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.368594 2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dh4vr" Jun 13 02:00:36.405168 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.405132 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" event={"ID":"97c5f5bba509447a5b7bb6659ffef353","Type":"ContainerStarted","Data":"efa999e9e5307d756c91bfc4f6511c4e4e677d45f7ec3c0123cd94cda97e7a04"} Jun 13 02:00:36.406295 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.406271 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" event={"ID":"19323d6ad4effe9e8837a575961bbbea","Type":"ContainerStarted","Data":"4e2ac23759c1ba7c0ad6d07ce84fcf3387e95e1b24e72325f52ab8deb78ad3d1"} Jun 13 02:00:36.429673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.429644 2546 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 02:00:36.438128 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438104 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96xfc\" (UniqueName: \"kubernetes.io/projected/c95ab1a5-4d9e-4dcb-8147-5780720d018b-kube-api-access-96xfc\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.438231 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438142 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-conf-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.438231 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438167 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-systemd\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.438342 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438224 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-device-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.438342 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438260 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-system-cni-dir\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.438342 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438288 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b71c502b-12b0-4975-a99f-600702275bff-cni-binary-copy\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.438342 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438314 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-var-lib-kubelet\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.438531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438344 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-kubelet-config\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.438531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438444 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.438531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438454 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-kubelet-config\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.438531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438471 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-systemd-units\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.438531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438495 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80458c5c-996b-48d1-850c-309bfb6e44c4-konnectivity-ca\") pod \"konnectivity-agent-pdlkg\" (UID: \"80458c5c-996b-48d1-850c-309bfb6e44c4\") " pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.438531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438518 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-modprobe-d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438539 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-lib-modules\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.438559 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438563 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhx7d\" (UniqueName: \"kubernetes.io/projected/38410839-e1e3-421c-9aba-7c9b3f42945f-kube-api-access-dhx7d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438589 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40eab1e5-112f-4d65-8fe3-6d5b2105d482-hosts-file\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.438647 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:36.938611762 +0000 UTC m=+2.886296675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438656 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40eab1e5-112f-4d65-8fe3-6d5b2105d482-hosts-file\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438667 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgzk\" (UniqueName: \"kubernetes.io/projected/b71c502b-12b0-4975-a99f-600702275bff-kube-api-access-lpgzk\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438699 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3559f0a6-d2aa-4467-9477-cd758312e4fb-host-slash\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438722 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cnibin\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438750 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-var-lib-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.438821 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438807 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-ovn\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438848 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-node-log\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438882 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-cni-multus\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438910 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3559f0a6-d2aa-4467-9477-cd758312e4fb-iptables-alerter-script\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438933 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99xz\" (UniqueName: \"kubernetes.io/projected/3559f0a6-d2aa-4467-9477-cd758312e4fb-kube-api-access-k99xz\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438959 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-run\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.438981 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-socket-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439002 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c95ab1a5-4d9e-4dcb-8147-5780720d018b-serviceca\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439032 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-netns\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439059 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-hostroot\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439081 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-sys\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439121 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-host\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439149 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439173 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-etc-selinux\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439197 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439220 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-cni-netd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.439353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439244 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439279 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-ovnkube-config\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.439282 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439307 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-socket-dir-parent\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.439359 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:00:36.939347747 +0000 UTC m=+2.887032644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439399 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-dbus\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439422 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5klfg\" (UniqueName: \"kubernetes.io/projected/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-kube-api-access-5klfg\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439444 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbhp\" (UniqueName: \"kubernetes.io/projected/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-kube-api-access-mmbhp\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439469 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-systemd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439503 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b71c502b-12b0-4975-a99f-600702275bff-multus-daemon-config\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439508 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-dbus\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439528 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-cnibin\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439550 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-os-release\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439582 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-log-socket\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439608 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-env-overrides\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439632 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc4sd\" (UniqueName: \"kubernetes.io/projected/055ab295-570e-41b1-93ae-df83f2cf7b42-kube-api-access-tc4sd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.440157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439674 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysconfig\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439698 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38410839-e1e3-421c-9aba-7c9b3f42945f-tmp\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439721 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-sys-fs\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439736 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-cni-bin\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439751 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-multus-certs\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439764 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-etc-kubernetes\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439800 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysctl-conf\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439838 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56g2q\" (UniqueName: \"kubernetes.io/projected/40eab1e5-112f-4d65-8fe3-6d5b2105d482-kube-api-access-56g2q\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439869 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-slash\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439896 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-etc-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439918 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-cni-bin\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439940 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-kubelet\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439966 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40eab1e5-112f-4d65-8fe3-6d5b2105d482-tmp-dir\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.439990 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-cni-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440015 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-kubernetes\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440038 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysctl-d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440084 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-tuned\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.441014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440117 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-run-netns\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440139 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80458c5c-996b-48d1-850c-309bfb6e44c4-agent-certs\") pod \"konnectivity-agent-pdlkg\" (UID: \"80458c5c-996b-48d1-850c-309bfb6e44c4\") " pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440342 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6x9x\" (UniqueName: \"kubernetes.io/projected/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-kube-api-access-g6x9x\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440414 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440454 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40eab1e5-112f-4d65-8fe3-6d5b2105d482-tmp-dir\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440445 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-ovnkube-script-lib\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440499 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-kubelet\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440531 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440555 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-system-cni-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440582 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440604 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440618 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-registration-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440633 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440648 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440682 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-run-ovn-kubernetes\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440707 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/055ab295-570e-41b1-93ae-df83f2cf7b42-ovn-node-metrics-cert\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.441777 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440736 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-k8s-cni-cncf-io\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.442548 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440795 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-os-release\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.442548 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.440837 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c95ab1a5-4d9e-4dcb-8147-5780720d018b-host\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.448180 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.448146 2546 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 02:00:36.448553 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.448535 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:36.448644 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.448559 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:36.448644 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.448571 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:36.448644 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.448634 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:36.948618312 +0000 UTC m=+2.896303227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:36.452092 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.452039 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56g2q\" (UniqueName: \"kubernetes.io/projected/40eab1e5-112f-4d65-8fe3-6d5b2105d482-kube-api-access-56g2q\") pod \"node-resolver-bhs2f\" (UID: \"40eab1e5-112f-4d65-8fe3-6d5b2105d482\") " pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.453311 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.453287 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6x9x\" (UniqueName: \"kubernetes.io/projected/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-kube-api-access-g6x9x\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.541110 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541080 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b71c502b-12b0-4975-a99f-600702275bff-multus-daemon-config\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541110 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541119 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-cnibin\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541144 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-os-release\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541177 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-log-socket\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541198 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-env-overrides\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541221 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc4sd\" (UniqueName: \"kubernetes.io/projected/055ab295-570e-41b1-93ae-df83f2cf7b42-kube-api-access-tc4sd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541236 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysconfig\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541261 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38410839-e1e3-421c-9aba-7c9b3f42945f-tmp\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541287 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-sys-fs\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541304 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-cni-bin\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541319 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-multus-certs\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541332 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-cnibin\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541334 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-etc-kubernetes\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541365 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-etc-kubernetes\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541387 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysctl-conf\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541395 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-log-socket\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541415 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-slash\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541442 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-etc-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541465 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-cni-bin\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541489 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-kubelet\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541516 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-cni-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541543 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-kubernetes\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541569 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysctl-d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541594 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-tuned\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541618 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-run-netns\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541643 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80458c5c-996b-48d1-850c-309bfb6e44c4-agent-certs\") pod \"konnectivity-agent-pdlkg\" (UID: \"80458c5c-996b-48d1-850c-309bfb6e44c4\") " pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541670 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541697 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-ovnkube-script-lib\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541702 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b71c502b-12b0-4975-a99f-600702275bff-multus-daemon-config\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.541802 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541722 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-kubelet\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541751 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541776 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-system-cni-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541830 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541846 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-env-overrides\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541854 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-registration-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541879 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541906 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541933 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-run-ovn-kubernetes\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541947 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysctl-conf\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541957 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/055ab295-570e-41b1-93ae-df83f2cf7b42-ovn-node-metrics-cert\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541981 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-k8s-cni-cncf-io\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541991 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-slash\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542006 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-os-release\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542028 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-etc-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542032 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c95ab1a5-4d9e-4dcb-8147-5780720d018b-host\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542056 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96xfc\" (UniqueName: \"kubernetes.io/projected/c95ab1a5-4d9e-4dcb-8147-5780720d018b-kube-api-access-96xfc\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.542649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542073 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-cni-bin\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542085 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-conf-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542110 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-systemd\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542134 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-device-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542144 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-cni-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542158 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-system-cni-dir\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542182 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b71c502b-12b0-4975-a99f-600702275bff-cni-binary-copy\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542206 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-var-lib-kubelet\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542263 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-systemd-units\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542279 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysctl-d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542290 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80458c5c-996b-48d1-850c-309bfb6e44c4-konnectivity-ca\") pod \"konnectivity-agent-pdlkg\" (UID: \"80458c5c-996b-48d1-850c-309bfb6e44c4\") " pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542316 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-modprobe-d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542342 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-lib-modules\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542370 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhx7d\" (UniqueName: \"kubernetes.io/projected/38410839-e1e3-421c-9aba-7c9b3f42945f-kube-api-access-dhx7d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542397 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgzk\" (UniqueName: \"kubernetes.io/projected/b71c502b-12b0-4975-a99f-600702275bff-kube-api-access-lpgzk\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542423 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3559f0a6-d2aa-4467-9477-cd758312e4fb-host-slash\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542448 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cnibin\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.543450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542473 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-var-lib-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542499 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-ovn\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542507 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-kubelet\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542525 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-node-log\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542564 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-cni-multus\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542595 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3559f0a6-d2aa-4467-9477-cd758312e4fb-iptables-alerter-script\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542624 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99xz\" (UniqueName: \"kubernetes.io/projected/3559f0a6-d2aa-4467-9477-cd758312e4fb-kube-api-access-k99xz\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542653 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-run\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542677 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-socket-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542705 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c95ab1a5-4d9e-4dcb-8147-5780720d018b-serviceca\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542730 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-netns\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542757 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-hostroot\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542775 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-system-cni-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542815 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-sys-fs\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541283 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-os-release\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542848 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-sys\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542875 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-cni-bin\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.541831 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-kubernetes\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.544206 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542887 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-run-netns\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542913 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-multus-certs\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542797 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-sys\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542930 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-kubelet\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542949 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-host\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542969 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-registration-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542991 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-etc-selinux\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543019 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543020 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-run\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543044 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-cni-netd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543070 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543083 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543104 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-ovnkube-config\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543128 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-socket-dir-parent\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543154 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5klfg\" (UniqueName: \"kubernetes.io/projected/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-kube-api-access-5klfg\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543178 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbhp\" (UniqueName: \"kubernetes.io/projected/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-kube-api-access-mmbhp\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543202 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-systemd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.544964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543274 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-systemd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543316 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-host\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543361 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-etc-selinux\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543485 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543499 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543537 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-cni-netd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543575 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543663 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b71c502b-12b0-4975-a99f-600702275bff-cni-binary-copy\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543729 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-var-lib-kubelet\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543797 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-systemd-units\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543835 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.543889 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-host-run-ovn-kubernetes\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544007 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-ovnkube-config\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544068 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-socket-dir-parent\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544267 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-sysconfig\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544298 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80458c5c-996b-48d1-850c-309bfb6e44c4-konnectivity-ca\") pod \"konnectivity-agent-pdlkg\" (UID: \"80458c5c-996b-48d1-850c-309bfb6e44c4\") " pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544334 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-k8s-cni-cncf-io\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.545666 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544392 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-os-release\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544428 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c95ab1a5-4d9e-4dcb-8147-5780720d018b-host\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544434 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/055ab295-570e-41b1-93ae-df83f2cf7b42-ovnkube-script-lib\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544434 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-modprobe-d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544503 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-lib-modules\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544507 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-var-lib-cni-multus\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542567 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-node-log\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544709 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-systemd\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544744 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c95ab1a5-4d9e-4dcb-8147-5780720d018b-serviceca\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544755 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-multus-conf-dir\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.542728 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544817 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-var-lib-openvswitch\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544826 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3559f0a6-d2aa-4467-9477-cd758312e4fb-host-slash\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544867 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-hostroot\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544869 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b71c502b-12b0-4975-a99f-600702275bff-host-run-netns\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544915 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544946 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/055ab295-570e-41b1-93ae-df83f2cf7b42-run-ovn\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544961 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-socket-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.546503 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.544977 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-cnibin\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.547397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.545021 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3559f0a6-d2aa-4467-9477-cd758312e4fb-iptables-alerter-script\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.547397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.545027 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-device-dir\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.547397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.545065 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-system-cni-dir\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.547397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.546877 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38410839-e1e3-421c-9aba-7c9b3f42945f-tmp\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.547397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.547015 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38410839-e1e3-421c-9aba-7c9b3f42945f-etc-tuned\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.548168 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.548141 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80458c5c-996b-48d1-850c-309bfb6e44c4-agent-certs\") pod \"konnectivity-agent-pdlkg\" (UID: \"80458c5c-996b-48d1-850c-309bfb6e44c4\") " pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.548426 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.548396 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/055ab295-570e-41b1-93ae-df83f2cf7b42-ovn-node-metrics-cert\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.549315 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.549294 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc4sd\" (UniqueName: \"kubernetes.io/projected/055ab295-570e-41b1-93ae-df83f2cf7b42-kube-api-access-tc4sd\") pod \"ovnkube-node-rs9pf\" (UID: \"055ab295-570e-41b1-93ae-df83f2cf7b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.552238 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.552209 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhx7d\" (UniqueName: \"kubernetes.io/projected/38410839-e1e3-421c-9aba-7c9b3f42945f-kube-api-access-dhx7d\") pod \"tuned-rgxld\" (UID: \"38410839-e1e3-421c-9aba-7c9b3f42945f\") " pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.552776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.552735 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99xz\" (UniqueName: \"kubernetes.io/projected/3559f0a6-d2aa-4467-9477-cd758312e4fb-kube-api-access-k99xz\") pod \"iptables-alerter-xgfzt\" (UID: \"3559f0a6-d2aa-4467-9477-cd758312e4fb\") " pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.553207 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.553165 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5klfg\" (UniqueName: \"kubernetes.io/projected/bcd80ea6-3a11-4f36-a64b-29e0fa628c81-kube-api-access-5klfg\") pod \"aws-ebs-csi-driver-node-6wt6b\" (UID: \"bcd80ea6-3a11-4f36-a64b-29e0fa628c81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.553566 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.553544 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgzk\" (UniqueName: \"kubernetes.io/projected/b71c502b-12b0-4975-a99f-600702275bff-kube-api-access-lpgzk\") pod \"multus-cpflc\" (UID: \"b71c502b-12b0-4975-a99f-600702275bff\") " pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.554073 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.554053 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbhp\" (UniqueName: \"kubernetes.io/projected/f9b3a324-b7d8-4bb7-a0a9-f3b756b70036-kube-api-access-mmbhp\") pod \"multus-additional-cni-plugins-fbdwg\" (UID: \"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036\") " pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.554161 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.554145 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96xfc\" (UniqueName: \"kubernetes.io/projected/c95ab1a5-4d9e-4dcb-8147-5780720d018b-kube-api-access-96xfc\") pod \"node-ca-nbmxr\" (UID: \"c95ab1a5-4d9e-4dcb-8147-5780720d018b\") " pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.641324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.641217 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bhs2f" Jun 13 02:00:36.651403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.651375 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" Jun 13 02:00:36.659116 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.659093 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" Jun 13 02:00:36.667569 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.667543 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:00:36.681461 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.681436 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbmxr" Jun 13 02:00:36.689179 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.689154 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cpflc" Jun 13 02:00:36.703793 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.703758 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:36.714513 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.714454 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgfzt" Jun 13 02:00:36.720195 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.720176 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rgxld" Jun 13 02:00:36.790888 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.790862 2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:36.945004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.944908 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:36.945004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:36.944972 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:36.945211 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.945075 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:36.945211 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.945131 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:36.945211 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.945153 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:37.945133112 +0000 UTC m=+3.892818011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:36.945211 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:36.945188 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:00:37.945171303 +0000 UTC m=+3.892856218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:37.045390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:37.045347 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:37.045577 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.045522 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:37.045577 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.045547 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:37.045577 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.045559 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:37.045708 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.045627 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:38.045608359 +0000 UTC m=+3.993293259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:37.373772 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:37.373691 2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:55:36 +0000 UTC" deadline="2028-03-01 08:34:38.505618792 +0000 UTC" Jun 13 02:00:37.373772 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:37.373774 2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15054h34m1.131853024s" Jun 13 02:00:37.391164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:37.391133 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:37.391314 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.391280 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:37.650238 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.650210 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95ab1a5_4d9e_4dcb_8147_5780720d018b.slice/crio-58bfa7cea66c2322b09d2087bc1ea53d557fdbfc6f35603b11335f98ffd55ffd WatchSource:0}: Error finding container 58bfa7cea66c2322b09d2087bc1ea53d557fdbfc6f35603b11335f98ffd55ffd: Status 404 returned error can't find the container with id 58bfa7cea66c2322b09d2087bc1ea53d557fdbfc6f35603b11335f98ffd55ffd Jun 13 02:00:37.652226 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.652205 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b3a324_b7d8_4bb7_a0a9_f3b756b70036.slice/crio-062dbc0a3cdc5dedcd1cfc57ac59935091724c633846251680302072564bf554 WatchSource:0}: Error finding container 062dbc0a3cdc5dedcd1cfc57ac59935091724c633846251680302072564bf554: Status 404 returned error can't find the container with id 062dbc0a3cdc5dedcd1cfc57ac59935091724c633846251680302072564bf554 Jun 13 02:00:37.653058 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.653032 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40eab1e5_112f_4d65_8fe3_6d5b2105d482.slice/crio-d6b44a980388639db590066539a09b1409b7f099ddc193c98e166e11401ac237 WatchSource:0}: Error finding container d6b44a980388639db590066539a09b1409b7f099ddc193c98e166e11401ac237: Status 404 returned error can't find the container with id d6b44a980388639db590066539a09b1409b7f099ddc193c98e166e11401ac237 Jun 13 02:00:37.654107 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.654078 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80458c5c_996b_48d1_850c_309bfb6e44c4.slice/crio-ca86c12f16f3f3c68e4ffff7b9238eadf91728319fad8183e19fbf274c2f38f7 WatchSource:0}: Error finding container ca86c12f16f3f3c68e4ffff7b9238eadf91728319fad8183e19fbf274c2f38f7: Status 404 returned error can't find the container with id ca86c12f16f3f3c68e4ffff7b9238eadf91728319fad8183e19fbf274c2f38f7 Jun 13 02:00:37.656758 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.656727 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd80ea6_3a11_4f36_a64b_29e0fa628c81.slice/crio-70f82bb31008bb678f6af2aacc6b09b948d5b3c5ae2244e6a768d845cb2e2e82 WatchSource:0}: Error finding container 70f82bb31008bb678f6af2aacc6b09b948d5b3c5ae2244e6a768d845cb2e2e82: Status 404 returned error can't find the container with id 70f82bb31008bb678f6af2aacc6b09b948d5b3c5ae2244e6a768d845cb2e2e82 Jun 13 02:00:37.658094 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.658074 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3559f0a6_d2aa_4467_9477_cd758312e4fb.slice/crio-6e69b5440a79c4be93a43f90da6259ae7e9bde98691e88d2693899da88ea7c90 WatchSource:0}: Error finding container 6e69b5440a79c4be93a43f90da6259ae7e9bde98691e88d2693899da88ea7c90: Status 404 returned error can't find the container with id 6e69b5440a79c4be93a43f90da6259ae7e9bde98691e88d2693899da88ea7c90 Jun 13 02:00:37.658917 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.658854 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38410839_e1e3_421c_9aba_7c9b3f42945f.slice/crio-5af52016320f22f6697d4b1767620085b9422151bc94ae00aa23d7eae2f66cb6 WatchSource:0}: Error finding container 5af52016320f22f6697d4b1767620085b9422151bc94ae00aa23d7eae2f66cb6: Status 404 returned error can't find the container with id 5af52016320f22f6697d4b1767620085b9422151bc94ae00aa23d7eae2f66cb6 Jun 13 02:00:37.660437 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.660316 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055ab295_570e_41b1_93ae_df83f2cf7b42.slice/crio-9acc97e332382c930e9a5635e08fa66ddd020cf42f810d6fe39351c09c4e7682 WatchSource:0}: Error finding container 9acc97e332382c930e9a5635e08fa66ddd020cf42f810d6fe39351c09c4e7682: Status 404 returned error can't find the container with id 9acc97e332382c930e9a5635e08fa66ddd020cf42f810d6fe39351c09c4e7682 Jun 13 02:00:37.661930 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:00:37.661764 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71c502b_12b0_4975_a99f_600702275bff.slice/crio-9135ec43d11a7a013f6a51e0ea86dcfef9ee3515b670c30fe4ce1b8c20d6c92d WatchSource:0}: Error finding container 9135ec43d11a7a013f6a51e0ea86dcfef9ee3515b670c30fe4ce1b8c20d6c92d: Status 404 returned error can't find the container with id 9135ec43d11a7a013f6a51e0ea86dcfef9ee3515b670c30fe4ce1b8c20d6c92d Jun 13 02:00:37.952414 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:37.952374 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:37.952414 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:37.952414 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:37.952596 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.952520 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:37.952596 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.952522 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:37.952596 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.952570 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:00:39.952558121 +0000 UTC m=+5.900243019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:37.952596 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:37.952582 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:39.952576828 +0000 UTC m=+5.900261727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:38.053227 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.053190 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:38.053389 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:38.053350 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:38.053389 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:38.053370 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:38.053389 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:38.053380 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:38.053494 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:38.053428 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:40.053414513 +0000 UTC m=+6.001099411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:38.374272 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.374202 2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:55:36 +0000 UTC" deadline="2027-12-10 23:01:28.581422529 +0000 UTC" Jun 13 02:00:38.374272 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.374241 2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13101h0m50.207186052s" Jun 13 02:00:38.393912 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.393164 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:38.393912 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:38.393335 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:38.393912 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.393753 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:38.393912 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:38.393860 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:38.435880 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.435722 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbmxr" event={"ID":"c95ab1a5-4d9e-4dcb-8147-5780720d018b","Type":"ContainerStarted","Data":"58bfa7cea66c2322b09d2087bc1ea53d557fdbfc6f35603b11335f98ffd55ffd"} Jun 13 02:00:38.441910 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.441406 2546 generic.go:356] "Generic (PLEG): container finished" podID="19323d6ad4effe9e8837a575961bbbea" containerID="50b1298af112b8ac1539b7dd31445b01d928c63b680de0941d80ce505fb82e4f" exitCode=0 Jun 13 02:00:38.441910 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.441488 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" event={"ID":"19323d6ad4effe9e8837a575961bbbea","Type":"ContainerDied","Data":"50b1298af112b8ac1539b7dd31445b01d928c63b680de0941d80ce505fb82e4f"} Jun 13 02:00:38.448132 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.448048 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cpflc" event={"ID":"b71c502b-12b0-4975-a99f-600702275bff","Type":"ContainerStarted","Data":"9135ec43d11a7a013f6a51e0ea86dcfef9ee3515b670c30fe4ce1b8c20d6c92d"} Jun 13 02:00:38.458971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.458866 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"9acc97e332382c930e9a5635e08fa66ddd020cf42f810d6fe39351c09c4e7682"} Jun 13 02:00:38.475168 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.475139 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rgxld" event={"ID":"38410839-e1e3-421c-9aba-7c9b3f42945f","Type":"ContainerStarted","Data":"5af52016320f22f6697d4b1767620085b9422151bc94ae00aa23d7eae2f66cb6"} Jun 13 02:00:38.493660 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.493627 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgfzt" event={"ID":"3559f0a6-d2aa-4467-9477-cd758312e4fb","Type":"ContainerStarted","Data":"6e69b5440a79c4be93a43f90da6259ae7e9bde98691e88d2693899da88ea7c90"} Jun 13 02:00:38.502446 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.502416 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" event={"ID":"97c5f5bba509447a5b7bb6659ffef353","Type":"ContainerStarted","Data":"927d7897956327f82ed21006c70628cd33b4137e16ad2b30c90f3e38f2d7905e"} Jun 13 02:00:38.512586 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.512514 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" event={"ID":"bcd80ea6-3a11-4f36-a64b-29e0fa628c81","Type":"ContainerStarted","Data":"70f82bb31008bb678f6af2aacc6b09b948d5b3c5ae2244e6a768d845cb2e2e82"} Jun 13 02:00:38.529688 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.529575 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pdlkg" event={"ID":"80458c5c-996b-48d1-850c-309bfb6e44c4","Type":"ContainerStarted","Data":"ca86c12f16f3f3c68e4ffff7b9238eadf91728319fad8183e19fbf274c2f38f7"} Jun 13 02:00:38.541276 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.541207 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bhs2f" event={"ID":"40eab1e5-112f-4d65-8fe3-6d5b2105d482","Type":"ContainerStarted","Data":"d6b44a980388639db590066539a09b1409b7f099ddc193c98e166e11401ac237"} Jun 13 02:00:38.560008 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:38.559980 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerStarted","Data":"062dbc0a3cdc5dedcd1cfc57ac59935091724c633846251680302072564bf554"} Jun 13 02:00:39.391407 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:39.390918 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:39.391407 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:39.391054 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:39.583914 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:39.583845 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" event={"ID":"19323d6ad4effe9e8837a575961bbbea","Type":"ContainerStarted","Data":"382899f0b92403c5da31b75bc2bc3e615804a8a8eb588d1a7486ec051cac869d"} Jun 13 02:00:39.598889 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:39.598828 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-133.ec2.internal" podStartSLOduration=4.59880802 podStartE2EDuration="4.59880802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:38.51535965 +0000 UTC m=+4.463044571" watchObservedRunningTime="2026-06-13 02:00:39.59880802 +0000 UTC m=+5.546492940" Jun 13 02:00:39.970062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:39.970019 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:39.970265 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:39.970094 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:39.970332 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:39.970263 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:39.970332 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:39.970328 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:00:43.970307999 +0000 UTC m=+9.917993001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:39.970958 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:39.970727 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:39.970958 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:39.970795 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:43.970763851 +0000 UTC m=+9.918448766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:40.070630 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:40.070574 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:40.070866 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:40.070848 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:40.070958 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:40.070874 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:40.070958 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:40.070887 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:40.071061 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:40.070948 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:44.070929885 +0000 UTC m=+10.018614800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:40.391420 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:40.391390 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:40.391894 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:40.391518 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:40.391967 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:40.391901 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:40.392026 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:40.391994 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:41.390552 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:41.390503 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:41.390742 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:41.390653 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:42.391075 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:42.391042 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:42.391556 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:42.391178 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:42.391690 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:42.391623 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:42.391755 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:42.391733 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:43.390681 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:43.390627 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:43.390931 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:43.390764 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:44.007044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:44.007007 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:44.007482 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:44.007062 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:44.007482 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.007172 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:44.007482 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.007207 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:44.007482 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.007253 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:52.007229716 +0000 UTC m=+17.954914624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:44.007482 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.007275 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:00:52.007264536 +0000 UTC m=+17.954949434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:44.108297 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:44.108216 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:44.108488 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.108396 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:44.108488 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.108422 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:44.108488 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.108436 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:44.108618 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.108500 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:52.108481178 +0000 UTC m=+18.056166082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:44.391703 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:44.391256 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:44.391703 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.391349 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:44.391703 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:44.391444 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:44.391703 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:44.391556 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:45.390891 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:45.390807 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:45.391339 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:45.390949 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:46.391406 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:46.391372 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:46.391900 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:46.391417 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:46.391900 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:46.391518 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:46.391900 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:46.391643 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:47.391264 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.391102 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:47.391264 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:47.391251 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:47.607915 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.607686 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rgxld" event={"ID":"38410839-e1e3-421c-9aba-7c9b3f42945f","Type":"ContainerStarted","Data":"895bb5a34bcd813e302724044d3f676b0d453bf971c14d05b95952dc10e458a2"} Jun 13 02:00:47.613433 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.613216 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" event={"ID":"bcd80ea6-3a11-4f36-a64b-29e0fa628c81","Type":"ContainerStarted","Data":"8bb00a1e882fe4e403bd6fea3ebba7c6af63096e3296d0267233ca0f5541a1d9"} Jun 13 02:00:47.617256 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.616767 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pdlkg" event={"ID":"80458c5c-996b-48d1-850c-309bfb6e44c4","Type":"ContainerStarted","Data":"5ed0c08acdebaeb19c12b0bdce8f88afcfe71d25310b343d4386e7979d140bf4"} Jun 13 02:00:47.621483 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.621380 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bhs2f" event={"ID":"40eab1e5-112f-4d65-8fe3-6d5b2105d482","Type":"ContainerStarted","Data":"a821bd899ad573dd6b69138bc782ef19432a98decf7cc3d6a7bb4ed0aef8380f"} Jun 13 02:00:47.624151 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.624105 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rgxld" podStartSLOduration=3.857238576 podStartE2EDuration="13.624085802s" totalImagesPullingTime="9.766847226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:47.623237165 +0000 UTC m=+13.570922084" watchObservedRunningTime="2026-06-13 02:00:47.624085802 +0000 UTC m=+13.571770726" Jun 13 02:00:47.624381 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.624351 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-133.ec2.internal" podStartSLOduration=12.624340481 podStartE2EDuration="12.624340481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:39.600084023 +0000 UTC m=+5.547768944" watchObservedRunningTime="2026-06-13 02:00:47.624340481 +0000 UTC m=+13.572025401" Jun 13 02:00:47.638024 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.637948 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bhs2f" podStartSLOduration=3.9017141950000003 podStartE2EDuration="13.637932953s" totalImagesPullingTime="9.736218758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:47.637534503 +0000 UTC m=+13.585219427" watchObservedRunningTime="2026-06-13 02:00:47.637932953 +0000 UTC m=+13.585617872" Jun 13 02:00:47.655593 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.655534 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pdlkg" podStartSLOduration=3.910862434 podStartE2EDuration="13.655512815s" totalImagesPullingTime="9.744650381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:47.655044585 +0000 UTC m=+13.602729505" watchObservedRunningTime="2026-06-13 02:00:47.655512815 +0000 UTC m=+13.603197736" Jun 13 02:00:47.674633 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:47.674581 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nbmxr" podStartSLOduration=3.926081602 podStartE2EDuration="13.67456464s" totalImagesPullingTime="9.748483038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:47.674406604 +0000 UTC m=+13.622091520" watchObservedRunningTime="2026-06-13 02:00:47.67456464 +0000 UTC m=+13.622249570" Jun 13 02:00:48.391110 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:48.391018 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:48.391258 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:48.391150 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:48.391258 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:48.391192 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:48.391360 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:48.391299 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:48.629114 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:48.629075 2546 generic.go:356] "Generic (PLEG): container finished" podID="f9b3a324-b7d8-4bb7-a0a9-f3b756b70036" containerID="0358563adc26ed9063c9dcbacbcaf1f39f50530558a08479e40a2c70c5105b27" exitCode=0 Jun 13 02:00:48.629668 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:48.629168 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerDied","Data":"0358563adc26ed9063c9dcbacbcaf1f39f50530558a08479e40a2c70c5105b27"} Jun 13 02:00:48.630856 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:48.630831 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbmxr" event={"ID":"c95ab1a5-4d9e-4dcb-8147-5780720d018b","Type":"ContainerStarted","Data":"663c85eab6851e9657c787828dc93bd130e89c96d48b1f619138cc322a8823b8"} Jun 13 02:00:49.390464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:49.390438 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:49.390711 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:49.390582 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:49.634974 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:49.634939 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgfzt" event={"ID":"3559f0a6-d2aa-4467-9477-cd758312e4fb","Type":"ContainerStarted","Data":"3e8058d5b653718cd121d079fca5b8b136dc586ccff2de3280d112d8d59232ac"} Jun 13 02:00:50.390889 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:50.390856 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:50.391059 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:50.390868 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:50.391059 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:50.390979 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:50.391191 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:50.391064 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:51.391085 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:51.391037 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:51.391475 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:51.391167 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:51.845482 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:51.845257 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:51.846021 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:51.845996 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:51.859988 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:51.859940 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xgfzt" podStartSLOduration=8.115348442 podStartE2EDuration="17.859922134s" totalImagesPullingTime="9.744573692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:49.648886826 +0000 UTC m=+15.596571748" watchObservedRunningTime="2026-06-13 02:00:51.859922134 +0000 UTC m=+17.807607055" Jun 13 02:00:52.067360 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:52.067328 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:52.067517 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:52.067415 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:52.067517 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.067487 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:52.067617 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.067546 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:01:08.067532806 +0000 UTC m=+34.015217717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:52.067617 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.067492 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:52.067617 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.067605 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:08.067594198 +0000 UTC m=+34.015279102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:52.168397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:52.168270 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:52.168557 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.168459 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:52.168557 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.168480 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:52.168557 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.168489 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:52.168557 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.168551 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:08.168532483 +0000 UTC m=+34.116217393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:52.390622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:52.390586 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:52.390821 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.390718 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:52.390972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:52.390942 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:52.391109 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:52.391039 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:53.390645 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:53.390613 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:53.390842 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:53.390754 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:54.307631 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:54.307258 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:54.307631 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:54.307429 2546 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 02:00:54.308106 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:54.307990 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pdlkg" Jun 13 02:00:54.391425 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:54.391394 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:54.391601 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:54.391493 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:54.391601 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:54.391514 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:54.391718 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:54.391633 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:55.390822 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:55.390796 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:55.391237 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:55.390925 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:56.390665 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:56.390633 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:56.391236 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:56.390771 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:56.391236 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:56.390825 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:56.391236 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:56.390934 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:57.390415 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:57.390385 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:57.390643 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:57.390499 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:58.390631 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:58.390588 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:00:58.391126 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:58.390728 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:00:58.391126 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:58.390814 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:00:58.391126 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:58.390939 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:00:59.176436 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.176406 2546 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 02:00:59.391087 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.390939 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:00:59.391407 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:00:59.391184 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:00:59.397119 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.397003 2546 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T02:00:59.176428061Z","UUID":"b411de8e-7b3d-48f5-8d3f-326c08103980","Handler":null,"Name":"","Endpoint":""} Jun 13 02:00:59.398610 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.398591 2546 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 02:00:59.398708 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.398626 2546 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 02:00:59.657352 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.657324 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cpflc" event={"ID":"b71c502b-12b0-4975-a99f-600702275bff","Type":"ContainerStarted","Data":"1bb93db1c64448447018c53ee93b7d6b6461b254ebc4fa661c35dbc80b352961"} Jun 13 02:00:59.659749 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.659723 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"194d50ef5915fddd7e285c6c958ee99705afe5a930c7b06b8a52a4e97e1b0478"} Jun 13 02:00:59.659854 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.659821 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"5a06296c3cbccadb0c9acf08b56e071365b6a8920c41bb46c017d0d5ddceb904"} Jun 13 02:00:59.659905 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.659870 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"e8ed4469755fb706a2a500bacffa4d3665f0682bbc6714ddcf20e04cc8ecf9bd"} Jun 13 02:00:59.659938 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.659918 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"5520fd879c097bb03ae8633f250cec3ee87a3588bc99703136a2644fea77c01f"} Jun 13 02:00:59.661453 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.661432 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" event={"ID":"bcd80ea6-3a11-4f36-a64b-29e0fa628c81","Type":"ContainerStarted","Data":"77ff4098a7ee914c051231534e96621cee8db1eb6263eb62da03150de6a1d300"} Jun 13 02:00:59.662941 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.662922 2546 generic.go:356] "Generic (PLEG): container finished" podID="f9b3a324-b7d8-4bb7-a0a9-f3b756b70036" containerID="04391c79d7520a9b2716ef1722029edb5bc10d238d497c08f94f30b6b50b0cf7" exitCode=0 Jun 13 02:00:59.663019 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.662954 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerDied","Data":"04391c79d7520a9b2716ef1722029edb5bc10d238d497c08f94f30b6b50b0cf7"} Jun 13 02:00:59.673072 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:00:59.673032 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cpflc" podStartSLOduration=4.301276722 podStartE2EDuration="25.673020459s" totalImagesPullingTime="21.371743737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:59.672418784 +0000 UTC m=+25.620103703" watchObservedRunningTime="2026-06-13 02:00:59.673020459 +0000 UTC m=+25.620705378" Jun 13 02:01:00.391312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.391284 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:00.392056 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.391293 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:00.392056 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:00.391413 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:00.392056 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:00.391487 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:00.666912 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.666885 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" event={"ID":"bcd80ea6-3a11-4f36-a64b-29e0fa628c81","Type":"ContainerStarted","Data":"e01d6ec84d7b47a4415a8080c9a698f953a706b775e798dd5be0c2b02c57e83f"} Jun 13 02:01:00.671536 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.671511 2546 generic.go:356] "Generic (PLEG): container finished" podID="f9b3a324-b7d8-4bb7-a0a9-f3b756b70036" containerID="249aed325093824e2966e3a9b40febf5c8e917d23f4153d0760a2f6c5c0b4a25" exitCode=0 Jun 13 02:01:00.671664 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.671587 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerDied","Data":"249aed325093824e2966e3a9b40febf5c8e917d23f4153d0760a2f6c5c0b4a25"} Jun 13 02:01:00.674490 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.674464 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"b31c9b822d965d5fcaf9411f410df1c9f55c97345a58e389d08706c7d177e236"} Jun 13 02:01:00.674707 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.674543 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"413fbace417b6349f2763bac05c6604c038ba5ff89b160c3878dd97cdde22f13"} Jun 13 02:01:00.701569 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:00.701529 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wt6b" podStartSLOduration=4.419127119 podStartE2EDuration="26.701516318s" totalImagesPullingTime="22.282389199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:00.681928606 +0000 UTC m=+26.629613526" watchObservedRunningTime="2026-06-13 02:01:00.701516318 +0000 UTC m=+26.649201238" Jun 13 02:01:01.390695 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:01.390672 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:01.390831 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:01.390771 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:01.679091 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:01.679000 2546 generic.go:356] "Generic (PLEG): container finished" podID="f9b3a324-b7d8-4bb7-a0a9-f3b756b70036" containerID="329405875a69180083ccb5615de9e65f719eae6e11a4cff929be6cc7984e3288" exitCode=0 Jun 13 02:01:01.679524 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:01.679095 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerDied","Data":"329405875a69180083ccb5615de9e65f719eae6e11a4cff929be6cc7984e3288"} Jun 13 02:01:02.391243 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:02.391211 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:02.391419 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:02.391322 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:02.391419 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:02.391331 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:02.391522 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:02.391472 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:02.685662 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:02.685582 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"d4a476c5d1707483abb6ba29c2ddce088ceffc3e1006d80d9e8da08f3947a622"} Jun 13 02:01:03.391411 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:03.391376 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:03.391587 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:03.391526 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:04.391792 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.391542 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:04.392236 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.391661 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:04.392236 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:04.391899 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:04.392236 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:04.392009 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:04.694771 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.694687 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" event={"ID":"055ab295-570e-41b1-93ae-df83f2cf7b42","Type":"ContainerStarted","Data":"2cc9e44fe7469dadcb8c05df3ccae7bfff4c2189f1b951736ca266c0839a19a9"} Jun 13 02:01:04.695018 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.694984 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:01:04.695149 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.695071 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:01:04.712648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.712620 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:01:04.718972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:04.718922 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" podStartSLOduration=9.291972633 podStartE2EDuration="30.718904883s" totalImagesPullingTime="21.42693225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:04.717681815 +0000 UTC m=+30.665366777" watchObservedRunningTime="2026-06-13 02:01:04.718904883 +0000 UTC m=+30.666589802" Jun 13 02:01:05.390954 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.390914 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:05.391129 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:05.391043 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:05.697842 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.697749 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:01:05.713773 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.713745 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:01:05.968428 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.968397 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gd9m8"] Jun 13 02:01:05.968552 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.968539 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:05.968682 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:05.968659 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:05.970920 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.970886 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdj28"] Jun 13 02:01:05.971035 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.970997 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:05.971136 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:05.971101 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:05.971592 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.971570 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dv4cc"] Jun 13 02:01:05.971676 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:05.971665 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:05.971762 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:05.971744 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:06.702019 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:06.701834 2546 generic.go:356] "Generic (PLEG): container finished" podID="f9b3a324-b7d8-4bb7-a0a9-f3b756b70036" containerID="f5782032bce3a9a60637feb03e44b5063ad46a3ab2a5aa9f7cae956cd7b03fae" exitCode=0 Jun 13 02:01:06.702471 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:06.701918 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerDied","Data":"f5782032bce3a9a60637feb03e44b5063ad46a3ab2a5aa9f7cae956cd7b03fae"} Jun 13 02:01:07.390622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:07.390587 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:07.390809 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:07.390694 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:07.390809 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:07.390702 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:07.390809 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:07.390721 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:07.390922 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:07.390814 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:07.390922 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:07.390886 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:07.706949 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:07.706860 2546 generic.go:356] "Generic (PLEG): container finished" podID="f9b3a324-b7d8-4bb7-a0a9-f3b756b70036" containerID="18e0b395e1e65947b5308229765107f453d67bf24fa377192fd4cb76cfe03835" exitCode=0 Jun 13 02:01:07.706949 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:07.706930 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerDied","Data":"18e0b395e1e65947b5308229765107f453d67bf24fa377192fd4cb76cfe03835"} Jun 13 02:01:08.089010 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:08.088982 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:08.089158 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:08.089021 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:08.089158 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.089118 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:08.089158 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.089119 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:08.089274 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.089165 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:01:40.089151873 +0000 UTC m=+66.036836772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:08.089274 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.089177 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret podName:c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:40.089171738 +0000 UTC m=+66.036856636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret") pod "global-pull-secret-syncer-fdj28" (UID: "c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:08.190112 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:08.190081 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:08.190256 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.190220 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:01:08.190256 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.190235 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:01:08.190256 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.190244 2546 projected.go:196] Error preparing data for projected volume kube-api-access-cdg7h for pod openshift-network-diagnostics/network-check-target-gd9m8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:08.190372 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:08.190294 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h podName:4c0f3f4a-6532-447d-909d-04cd549be337 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:40.190279025 +0000 UTC m=+66.137963942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdg7h" (UniqueName: "kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h") pod "network-check-target-gd9m8" (UID: "4c0f3f4a-6532-447d-909d-04cd549be337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:08.712381 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:08.712351 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" event={"ID":"f9b3a324-b7d8-4bb7-a0a9-f3b756b70036","Type":"ContainerStarted","Data":"7df0b2c7e496e510bf944c999add7c3a0b397156fe0260bf352512f966fb1d5b"} Jun 13 02:01:08.732978 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:08.732930 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbdwg" podStartSLOduration=8.619534091 podStartE2EDuration="34.732914262s" totalImagesPullingTime="26.113380171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:08.731665829 +0000 UTC m=+34.679350749" watchObservedRunningTime="2026-06-13 02:01:08.732914262 +0000 UTC m=+34.680599176" Jun 13 02:01:09.390618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:09.390577 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:09.390810 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:09.390621 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:09.390810 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:09.390621 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:09.390810 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:09.390685 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:09.390919 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:09.390803 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:09.390919 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:09.390846 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:11.390901 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:11.390863 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:11.391370 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:11.390871 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:11.391370 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:11.390979 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:01:11.391370 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:11.391077 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdj28" podUID="c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21" Jun 13 02:01:11.391370 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:11.390881 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:11.391370 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:11.391181 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gd9m8" podUID="4c0f3f4a-6532-447d-909d-04cd549be337" Jun 13 02:01:12.846005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.845977 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-133.ec2.internal" event="NodeReady" Jun 13 02:01:12.846488 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.846116 2546 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 02:01:12.881949 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.881914 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f8d6d6c8-47ld6"] Jun 13 02:01:12.901371 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.901339 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb"] Jun 13 02:01:12.902101 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.902070 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:12.904871 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.904648 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x269m\"" Jun 13 02:01:12.905060 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.904993 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 02:01:12.905060 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.905002 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 02:01:12.905468 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.905445 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 02:01:12.910406 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.910375 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 02:01:12.911549 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.911532 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4"] Jun 13 02:01:12.911650 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.911636 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:12.914576 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.914444 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 13 02:01:12.915817 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.915679 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 13 02:01:12.916907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.916883 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 13 02:01:12.917073 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.917053 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 13 02:01:12.940443 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.940414 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt"] Jun 13 02:01:12.940582 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.940541 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:12.942832 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.942806 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 13 02:01:12.943016 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.943003 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 13 02:01:12.943101 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.943074 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 13 02:01:12.943169 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.943118 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 13 02:01:12.956510 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.956488 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb"] Jun 13 02:01:12.956627 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.956525 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mfm6d"] Jun 13 02:01:12.956627 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.956608 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:12.959867 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.959850 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fjgkm\"" Jun 13 02:01:12.960335 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.960320 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 13 02:01:12.978669 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.978651 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt"] Jun 13 02:01:12.978753 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.978677 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r82jc"] Jun 13 02:01:12.978804 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.978765 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:12.981648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.981631 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 02:01:12.981767 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.981752 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc58g\"" Jun 13 02:01:12.982157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.982144 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 02:01:12.998826 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.998773 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f8d6d6c8-47ld6"] Jun 13 02:01:12.998916 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.998842 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4"] Jun 13 02:01:12.998916 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.998857 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:12.998916 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.998867 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r82jc"] Jun 13 02:01:12.998916 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:12.998887 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mfm6d"] Jun 13 02:01:13.003729 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.003707 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 02:01:13.003920 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.003900 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n4zgq\"" Jun 13 02:01:13.004017 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.003898 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 02:01:13.004017 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.003975 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 02:01:13.027575 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027548 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-image-registry-private-configuration\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027587 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-certificates\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027607 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-ca-trust-extracted\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027624 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3926f067-735b-48af-807c-c7995e39163c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027648 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027671 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-bound-sa-token\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027694 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-ca\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027711 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-hub\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.027745 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027732 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027796 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d5a9aed-881c-4d1b-b942-61cd7844e22a-klusterlet-config\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027845 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d5a9aed-881c-4d1b-b942-61cd7844e22a-tmp\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027871 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttf4\" (UniqueName: \"kubernetes.io/projected/3926f067-735b-48af-807c-c7995e39163c-kube-api-access-6ttf4\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027898 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-trusted-ca\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027917 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-installation-pull-secrets\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027943 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5k4b\" (UniqueName: \"kubernetes.io/projected/9d5a9aed-881c-4d1b-b942-61cd7844e22a-kube-api-access-g5k4b\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.027969 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.028007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.028001 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kknfs\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-kube-api-access-kknfs\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.071220 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.071174 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:13.129183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129086 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.129183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129126 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tq5r\" (UniqueName: \"kubernetes.io/projected/65a5d3e8-cb09-42a1-9431-5298d210dccf-kube-api-access-7tq5r\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.129183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129146 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlkhq\" (UniqueName: \"kubernetes.io/projected/88f3e852-7672-494b-a76d-32aecbbea0da-kube-api-access-wlkhq\") pod \"ingress-canary-r82jc\" (UID: \"88f3e852-7672-494b-a76d-32aecbbea0da\") " pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.129183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129170 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d5a9aed-881c-4d1b-b942-61cd7844e22a-tmp\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129194 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttf4\" (UniqueName: \"kubernetes.io/projected/3926f067-735b-48af-807c-c7995e39163c-kube-api-access-6ttf4\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129214 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88f3e852-7672-494b-a76d-32aecbbea0da-cert\") pod \"ingress-canary-r82jc\" (UID: \"88f3e852-7672-494b-a76d-32aecbbea0da\") " pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129231 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-trusted-ca\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129250 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-installation-pull-secrets\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129272 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48dda147-3844-4dd4-9f0e-e74d0e2532d0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-776c7868b6-msrpt\" (UID: \"48dda147-3844-4dd4-9f0e-e74d0e2532d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129299 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5k4b\" (UniqueName: \"kubernetes.io/projected/9d5a9aed-881c-4d1b-b942-61cd7844e22a-kube-api-access-g5k4b\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129322 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129345 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4s8l\" (UniqueName: \"kubernetes.io/projected/48dda147-3844-4dd4-9f0e-e74d0e2532d0-kube-api-access-j4s8l\") pod \"managed-serviceaccount-addon-agent-776c7868b6-msrpt\" (UID: \"48dda147-3844-4dd4-9f0e-e74d0e2532d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129374 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kknfs\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-kube-api-access-kknfs\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129396 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5d3e8-cb09-42a1-9431-5298d210dccf-tmp-dir\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.129491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129451 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-image-registry-private-configuration\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129498 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-certificates\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129528 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-ca-trust-extracted\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129552 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3926f067-735b-48af-807c-c7995e39163c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129589 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129614 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-bound-sa-token\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.129673 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d5a9aed-881c-4d1b-b942-61cd7844e22a-tmp\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.129882 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.129900 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:13.130040 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.129955 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:13.629935151 +0000 UTC m=+39.577620053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:13.130470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130207 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-certificates\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130334 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-ca\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.130470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130368 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5d3e8-cb09-42a1-9431-5298d210dccf-config-volume\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.130470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130402 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-hub\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.130470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130429 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.130470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130463 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d5a9aed-881c-4d1b-b942-61cd7844e22a-klusterlet-config\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.130713 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130506 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-ca-trust-extracted\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130713 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130518 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-trusted-ca\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.130713 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.130526 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3926f067-735b-48af-807c-c7995e39163c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.134436 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.134408 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-image-registry-private-configuration\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.134436 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.134421 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-installation-pull-secrets\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.134436 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.134434 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-ca\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.134652 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.134442 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.134652 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.134512 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d5a9aed-881c-4d1b-b942-61cd7844e22a-klusterlet-config\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.134652 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.134517 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-hub\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.135029 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.135007 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3926f067-735b-48af-807c-c7995e39163c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.138141 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.138121 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5k4b\" (UniqueName: \"kubernetes.io/projected/9d5a9aed-881c-4d1b-b942-61cd7844e22a-kube-api-access-g5k4b\") pod \"klusterlet-addon-workmgr-58cdd56969-dgzlb\" (UID: \"9d5a9aed-881c-4d1b-b942-61cd7844e22a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.138300 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.138277 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kknfs\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-kube-api-access-kknfs\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.138550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.138530 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttf4\" (UniqueName: \"kubernetes.io/projected/3926f067-735b-48af-807c-c7995e39163c-kube-api-access-6ttf4\") pod \"cluster-proxy-proxy-agent-5489cc949b-x59s4\" (UID: \"3926f067-735b-48af-807c-c7995e39163c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.138700 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.138677 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-bound-sa-token\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.157359 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.157334 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:13.225393 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.225360 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:13.231639 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.231604 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88f3e852-7672-494b-a76d-32aecbbea0da-cert\") pod \"ingress-canary-r82jc\" (UID: \"88f3e852-7672-494b-a76d-32aecbbea0da\") " pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.231768 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.231651 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48dda147-3844-4dd4-9f0e-e74d0e2532d0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-776c7868b6-msrpt\" (UID: \"48dda147-3844-4dd4-9f0e-e74d0e2532d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.231768 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.231679 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4s8l\" (UniqueName: \"kubernetes.io/projected/48dda147-3844-4dd4-9f0e-e74d0e2532d0-kube-api-access-j4s8l\") pod \"managed-serviceaccount-addon-agent-776c7868b6-msrpt\" (UID: \"48dda147-3844-4dd4-9f0e-e74d0e2532d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.231768 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.231703 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5d3e8-cb09-42a1-9431-5298d210dccf-tmp-dir\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.232016 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.231991 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5d3e8-cb09-42a1-9431-5298d210dccf-config-volume\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.232074 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.232039 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5d3e8-cb09-42a1-9431-5298d210dccf-tmp-dir\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.232074 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.232048 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.232175 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.232078 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tq5r\" (UniqueName: \"kubernetes.io/projected/65a5d3e8-cb09-42a1-9431-5298d210dccf-kube-api-access-7tq5r\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.232175 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.232146 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:13.232270 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.232205 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:01:13.732185392 +0000 UTC m=+39.679870306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:13.232270 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.232226 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlkhq\" (UniqueName: \"kubernetes.io/projected/88f3e852-7672-494b-a76d-32aecbbea0da-kube-api-access-wlkhq\") pod \"ingress-canary-r82jc\" (UID: \"88f3e852-7672-494b-a76d-32aecbbea0da\") " pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.232469 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.232447 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65a5d3e8-cb09-42a1-9431-5298d210dccf-config-volume\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.234655 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.234634 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88f3e852-7672-494b-a76d-32aecbbea0da-cert\") pod \"ingress-canary-r82jc\" (UID: \"88f3e852-7672-494b-a76d-32aecbbea0da\") " pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.234735 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.234698 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48dda147-3844-4dd4-9f0e-e74d0e2532d0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-776c7868b6-msrpt\" (UID: \"48dda147-3844-4dd4-9f0e-e74d0e2532d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.242593 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.242560 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tq5r\" (UniqueName: \"kubernetes.io/projected/65a5d3e8-cb09-42a1-9431-5298d210dccf-kube-api-access-7tq5r\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.243306 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.243279 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlkhq\" (UniqueName: \"kubernetes.io/projected/88f3e852-7672-494b-a76d-32aecbbea0da-kube-api-access-wlkhq\") pod \"ingress-canary-r82jc\" (UID: \"88f3e852-7672-494b-a76d-32aecbbea0da\") " pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.243385 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.243364 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4s8l\" (UniqueName: \"kubernetes.io/projected/48dda147-3844-4dd4-9f0e-e74d0e2532d0-kube-api-access-j4s8l\") pod \"managed-serviceaccount-addon-agent-776c7868b6-msrpt\" (UID: \"48dda147-3844-4dd4-9f0e-e74d0e2532d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.264322 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.264287 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:01:13.270433 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.270410 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:01:13.307556 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.307520 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r82jc" Jun 13 02:01:13.393050 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.391174 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:13.393050 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.391638 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:13.393050 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.392098 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:13.395892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.394488 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 02:01:13.395892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.395044 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 02:01:13.395892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.395301 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 02:01:13.395892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.395557 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xr6x\"" Jun 13 02:01:13.395892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.395637 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 02:01:13.395892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.395774 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sngzk\"" Jun 13 02:01:13.465346 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.465311 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb"] Jun 13 02:01:13.468261 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.468152 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4"] Jun 13 02:01:13.469181 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:01:13.469150 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5a9aed_881c_4d1b_b942_61cd7844e22a.slice/crio-e33dabe0440c75ad2ae5e5fd4109b684c268b8742dcdb5c4c39019fa1c4e62b4 WatchSource:0}: Error finding container e33dabe0440c75ad2ae5e5fd4109b684c268b8742dcdb5c4c39019fa1c4e62b4: Status 404 returned error can't find the container with id e33dabe0440c75ad2ae5e5fd4109b684c268b8742dcdb5c4c39019fa1c4e62b4 Jun 13 02:01:13.471051 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:01:13.470959 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3926f067_735b_48af_807c_c7995e39163c.slice/crio-b0f382756cbf255be06136592cbdcec30103d21ce51af8dac0a9de16ee9e6e2b WatchSource:0}: Error finding container b0f382756cbf255be06136592cbdcec30103d21ce51af8dac0a9de16ee9e6e2b: Status 404 returned error can't find the container with id b0f382756cbf255be06136592cbdcec30103d21ce51af8dac0a9de16ee9e6e2b Jun 13 02:01:13.481444 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.481414 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt"] Jun 13 02:01:13.484085 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:01:13.484061 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48dda147_3844_4dd4_9f0e_e74d0e2532d0.slice/crio-481fdb6c7d10ebbca344299da9c273ac8dc2730893dcd4eef31c9cd343e13931 WatchSource:0}: Error finding container 481fdb6c7d10ebbca344299da9c273ac8dc2730893dcd4eef31c9cd343e13931: Status 404 returned error can't find the container with id 481fdb6c7d10ebbca344299da9c273ac8dc2730893dcd4eef31c9cd343e13931 Jun 13 02:01:13.518062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.518026 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r82jc"] Jun 13 02:01:13.520915 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:01:13.520889 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f3e852_7672_494b_a76d_32aecbbea0da.slice/crio-1bae1d1155b07e4e784f20dc0f20f4d7756a0dc7b07dd8ea50c62f5b59d56f89 WatchSource:0}: Error finding container 1bae1d1155b07e4e784f20dc0f20f4d7756a0dc7b07dd8ea50c62f5b59d56f89: Status 404 returned error can't find the container with id 1bae1d1155b07e4e784f20dc0f20f4d7756a0dc7b07dd8ea50c62f5b59d56f89 Jun 13 02:01:13.637769 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.637733 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:13.637939 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.637891 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:13.637939 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.637909 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:13.638024 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.637964 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:14.637948713 +0000 UTC m=+40.585633611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:13.723896 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.723805 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r82jc" event={"ID":"88f3e852-7672-494b-a76d-32aecbbea0da","Type":"ContainerStarted","Data":"1bae1d1155b07e4e784f20dc0f20f4d7756a0dc7b07dd8ea50c62f5b59d56f89"} Jun 13 02:01:13.724775 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.724754 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" event={"ID":"3926f067-735b-48af-807c-c7995e39163c","Type":"ContainerStarted","Data":"b0f382756cbf255be06136592cbdcec30103d21ce51af8dac0a9de16ee9e6e2b"} Jun 13 02:01:13.725726 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.725708 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" event={"ID":"9d5a9aed-881c-4d1b-b942-61cd7844e22a","Type":"ContainerStarted","Data":"e33dabe0440c75ad2ae5e5fd4109b684c268b8742dcdb5c4c39019fa1c4e62b4"} Jun 13 02:01:13.726653 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.726627 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" event={"ID":"48dda147-3844-4dd4-9f0e-e74d0e2532d0","Type":"ContainerStarted","Data":"481fdb6c7d10ebbca344299da9c273ac8dc2730893dcd4eef31c9cd343e13931"} Jun 13 02:01:13.738234 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:13.738212 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:13.738344 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.738330 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:13.738402 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:13.738392 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:01:14.738378039 +0000 UTC m=+40.686062938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:14.491343 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:14.491255 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:14.592213 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:14.592128 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:14.645447 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:14.645302 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:14.645447 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:14.645435 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:14.645447 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:14.645459 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:14.645752 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:14.645529 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:16.645506418 +0000 UTC m=+42.593191330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:14.746176 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:14.746084 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:14.746413 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:14.746276 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:14.746413 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:14.746350 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:01:16.746330418 +0000 UTC m=+42.694015329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:16.662019 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:16.661765 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:16.662431 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:16.661924 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:16.662431 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:16.662122 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:16.662431 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:16.662193 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:20.662175143 +0000 UTC m=+46.609860063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:16.763235 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:16.763182 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:16.763435 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:16.763412 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:16.763518 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:16.763485 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:01:20.763466233 +0000 UTC m=+46.711151140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:16.951733 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:16.951649 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:17.004185 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:17.004129 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:17.056759 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:17.056723 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:17.342485 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:17.342437 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:17.445483 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:17.445449 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:17.982717 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:17.982667 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:18.316654 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:18.316565 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:18.366369 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:18.366335 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:18.864118 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:18.864075 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:18.965507 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:18.965469 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:20.681660 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:20.681620 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:20.693671 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:20.693646 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:20.693833 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:20.693814 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:20.693833 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:20.693833 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:20.693941 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:20.693884 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:28.693866071 +0000 UTC m=+54.641550972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:20.781581 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:20.781541 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:20.794284 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:20.794259 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:20.794391 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:20.794372 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:20.794454 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:20.794447 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:01:28.794426657 +0000 UTC m=+54.742111557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:21.751403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.751360 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" event={"ID":"3926f067-735b-48af-807c-c7995e39163c","Type":"ContainerStarted","Data":"0046e00732100a3da3db059be877094dca0e35149879405082128374927ce5fb"} Jun 13 02:01:21.751892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.751418 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" event={"ID":"3926f067-735b-48af-807c-c7995e39163c","Type":"ContainerStarted","Data":"e1375824b2c543ddacc4717d9989673250578d6c848e2b262f01547fadc5864e"} Jun 13 02:01:21.751892 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.751436 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" event={"ID":"3926f067-735b-48af-807c-c7995e39163c","Type":"ContainerStarted","Data":"cce374a30e41f6a6a984650286050f64f17dd5cc3dabda324601116f6aaae903"} Jun 13 02:01:21.752793 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.752751 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" event={"ID":"9d5a9aed-881c-4d1b-b942-61cd7844e22a","Type":"ContainerStarted","Data":"ca558cb27b7afe19d0249a9a45527c0fb4ecdf1afd751b66a7ba8cd7e221eb01"} Jun 13 02:01:21.752922 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.752850 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:21.754285 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.754257 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" event={"ID":"48dda147-3844-4dd4-9f0e-e74d0e2532d0","Type":"ContainerStarted","Data":"65f699a14c30410a4c76d4ab7314f7aa92a40dc1b67c1c0bbabc6e62f24913c6"} Jun 13 02:01:21.754907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.754887 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:01:21.755799 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.755758 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r82jc" event={"ID":"88f3e852-7672-494b-a76d-32aecbbea0da","Type":"ContainerStarted","Data":"d8a4d5f04da4fb356d5ef375885ae8e5f809179347b2106df71ee0e2f8744333"} Jun 13 02:01:21.770189 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.770148 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" podStartSLOduration=25.526756987 podStartE2EDuration="32.770135438s" totalImagesPullingTime="7.243378451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:21.769540195 +0000 UTC m=+47.717225137" watchObservedRunningTime="2026-06-13 02:01:21.770135438 +0000 UTC m=+47.717820358" Jun 13 02:01:21.784549 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.784500 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" podStartSLOduration=25.551247144 podStartE2EDuration="32.784459307s" totalImagesPullingTime="7.233212163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:21.783495989 +0000 UTC m=+47.731180910" watchObservedRunningTime="2026-06-13 02:01:21.784459307 +0000 UTC m=+47.732144227" Jun 13 02:01:21.801302 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.801252 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" podStartSLOduration=25.584436434 podStartE2EDuration="32.801237698s" totalImagesPullingTime="7.216801264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:21.800323674 +0000 UTC m=+47.748008595" watchObservedRunningTime="2026-06-13 02:01:21.801237698 +0000 UTC m=+47.748922618" Jun 13 02:01:21.816688 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:21.816639 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r82jc" podStartSLOduration=2.649717888 podStartE2EDuration="9.816624771s" totalImagesPullingTime="7.166906883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:21.815897483 +0000 UTC m=+47.763582405" watchObservedRunningTime="2026-06-13 02:01:21.816624771 +0000 UTC m=+47.764309669" Jun 13 02:01:25.257286 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:25.257224 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:27.714383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:27.714352 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:27.776955 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:27.776917 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:28.755648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:28.755610 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:28.756173 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:28.755817 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:28.756173 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:28.755840 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:28.756173 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:28.755925 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:44.75590406 +0000 UTC m=+70.703588961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:28.856222 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:28.856178 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:28.856366 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:28.856343 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:28.856432 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:28.856416 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:01:44.85640003 +0000 UTC m=+70.804084928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:29.295180 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:29.295139 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:29.393486 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:29.393433 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:31.066866 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:31.066834 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:31.119122 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:31.119087 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:34.427054 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:34.427006 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:34.475093 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:34.475056 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:37.721474 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:37.721440 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rs9pf" Jun 13 02:01:37.880793 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:37.880758 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:37.934097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:37.934063 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:39.322729 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:39.322691 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:39.372003 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:39.371966 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:40.143594 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.143557 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:40.143822 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.143623 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:01:40.147398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.147378 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 02:01:40.147453 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.147383 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 02:01:40.154461 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:40.154444 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:01:40.154507 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:40.154499 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:02:44.154484891 +0000 UTC m=+130.102169788 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : secret "metrics-daemon-secret" not found Jun 13 02:01:40.157588 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.157568 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21-original-pull-secret\") pod \"global-pull-secret-syncer-fdj28\" (UID: \"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21\") " pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:40.244659 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.244622 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:40.247291 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.247273 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 02:01:40.257314 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.257288 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 02:01:40.268713 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.268679 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdg7h\" (UniqueName: \"kubernetes.io/projected/4c0f3f4a-6532-447d-909d-04cd549be337-kube-api-access-cdg7h\") pod \"network-check-target-gd9m8\" (UID: \"4c0f3f4a-6532-447d-909d-04cd549be337\") " pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:40.413450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.413376 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdj28" Jun 13 02:01:40.424252 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.424229 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xr6x\"" Jun 13 02:01:40.432379 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.432359 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:40.643202 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.643089 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdj28"] Jun 13 02:01:40.647205 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:01:40.647178 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c9a1be_c2ac_4a44_b4ab_2bf413ea3d21.slice/crio-2d1bdea38bc34eb5f802e828189a2518cb951837a96b06cc6fed1e69ac0eb7a9 WatchSource:0}: Error finding container 2d1bdea38bc34eb5f802e828189a2518cb951837a96b06cc6fed1e69ac0eb7a9: Status 404 returned error can't find the container with id 2d1bdea38bc34eb5f802e828189a2518cb951837a96b06cc6fed1e69ac0eb7a9 Jun 13 02:01:40.659930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.659901 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gd9m8"] Jun 13 02:01:40.662686 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:01:40.662663 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0f3f4a_6532_447d_909d_04cd549be337.slice/crio-7318bc79b1a519466ace66e1cb88ca6139d7487ea763198d2aa5e8cc6c3b439d WatchSource:0}: Error finding container 7318bc79b1a519466ace66e1cb88ca6139d7487ea763198d2aa5e8cc6c3b439d: Status 404 returned error can't find the container with id 7318bc79b1a519466ace66e1cb88ca6139d7487ea763198d2aa5e8cc6c3b439d Jun 13 02:01:40.812238 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.812198 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gd9m8" event={"ID":"4c0f3f4a-6532-447d-909d-04cd549be337","Type":"ContainerStarted","Data":"7318bc79b1a519466ace66e1cb88ca6139d7487ea763198d2aa5e8cc6c3b439d"} Jun 13 02:01:40.813226 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:40.813205 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdj28" event={"ID":"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21","Type":"ContainerStarted","Data":"2d1bdea38bc34eb5f802e828189a2518cb951837a96b06cc6fed1e69ac0eb7a9"} Jun 13 02:01:44.776461 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:44.776417 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:01:44.776988 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:44.776588 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:01:44.776988 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:44.776612 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:01:44.776988 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:44.776742 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:02:16.776715017 +0000 UTC m=+102.724399934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:01:44.827711 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:44.827678 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gd9m8" event={"ID":"4c0f3f4a-6532-447d-909d-04cd549be337","Type":"ContainerStarted","Data":"3d7f26c89fe25191682689a0fc104b2faec660a864ef0c8c1650b54031cd6399"} Jun 13 02:01:44.827926 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:44.827813 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:01:44.844095 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:44.844025 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gd9m8" podStartSLOduration=67.676865648 podStartE2EDuration="1m10.844003406s" totalImagesPullingTime="3.167137758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:44.842088305 +0000 UTC m=+70.789773225" watchObservedRunningTime="2026-06-13 02:01:44.844003406 +0000 UTC m=+70.791688327" Jun 13 02:01:44.877041 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:44.877006 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:01:44.877237 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:44.877166 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:44.877298 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:01:44.877238 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:02:16.877215833 +0000 UTC m=+102.824900754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:01:46.836703 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:46.836666 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdj28" event={"ID":"c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21","Type":"ContainerStarted","Data":"2582238099bf53b709b56c1e62409eec4a24af1fc3002feee2c87d17482153d2"} Jun 13 02:01:46.851750 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:46.851699 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdj28" podStartSLOduration=67.684666646 podStartE2EDuration="1m12.851683148s" totalImagesPullingTime="5.167016502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:46.850841539 +0000 UTC m=+72.798526459" watchObservedRunningTime="2026-06-13 02:01:46.851683148 +0000 UTC m=+72.799368067" Jun 13 02:01:55.006887 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:55.006752 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:55.058513 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:55.058481 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:01:55.109838 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:01:55.109801 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:02:15.834286 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:02:15.834191 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gd9m8" Jun 13 02:02:16.807368 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:02:16.807330 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:02:16.807549 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:16.807479 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:02:16.807549 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:16.807493 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:02:16.807549 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:16.807546 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:03:20.807529994 +0000 UTC m=+166.755215133 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:02:16.908481 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:02:16.908442 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:02:16.908882 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:16.908563 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:02:16.908882 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:16.908617 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:03:20.908602584 +0000 UTC m=+166.856287482 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:02:44.210086 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:02:44.210037 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:02:44.210561 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:44.210187 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:02:44.210561 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:02:44.210256 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.210240752 +0000 UTC m=+252.157925650 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : secret "metrics-daemon-secret" not found Jun 13 02:03:15.914208 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:15.914126 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" Jun 13 02:03:16.001441 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:16.001399 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mfm6d" podUID="65a5d3e8-cb09-42a1-9431-5298d210dccf" Jun 13 02:03:16.092003 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:16.091972 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mfm6d" Jun 13 02:03:16.092152 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:16.091975 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:03:16.431649 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:16.431594 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:03:20.869854 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:20.869737 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:03:20.870239 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:20.869895 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 02:03:20.870239 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:20.869916 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f8d6d6c8-47ld6: secret "image-registry-tls" not found Jun 13 02:03:20.870239 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:20.869983 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls podName:9a59b0f3-54cf-4de6-87a2-37a107a9a96e nodeName:}" failed. No retries permitted until 2026-06-13 02:05:22.869968356 +0000 UTC m=+288.817653253 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls") pod "image-registry-7f8d6d6c8-47ld6" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e") : secret "image-registry-tls" not found Jun 13 02:03:20.970846 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:20.970814 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:03:20.971022 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:20.970986 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:03:20.971072 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:03:20.971062 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls podName:65a5d3e8-cb09-42a1-9431-5298d210dccf nodeName:}" failed. No retries permitted until 2026-06-13 02:05:22.971045744 +0000 UTC m=+288.918730642 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls") pod "dns-default-mfm6d" (UID: "65a5d3e8-cb09-42a1-9431-5298d210dccf") : secret "dns-default-metrics-tls" not found Jun 13 02:03:21.107271 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.107235 2546 generic.go:356] "Generic (PLEG): container finished" podID="9d5a9aed-881c-4d1b-b942-61cd7844e22a" containerID="ca558cb27b7afe19d0249a9a45527c0fb4ecdf1afd751b66a7ba8cd7e221eb01" exitCode=1 Jun 13 02:03:21.107455 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.107315 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" event={"ID":"9d5a9aed-881c-4d1b-b942-61cd7844e22a","Type":"ContainerDied","Data":"ca558cb27b7afe19d0249a9a45527c0fb4ecdf1afd751b66a7ba8cd7e221eb01"} Jun 13 02:03:21.107707 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.107692 2546 scope.go:117] "RemoveContainer" containerID="ca558cb27b7afe19d0249a9a45527c0fb4ecdf1afd751b66a7ba8cd7e221eb01" Jun 13 02:03:21.108728 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.108708 2546 generic.go:356] "Generic (PLEG): container finished" podID="48dda147-3844-4dd4-9f0e-e74d0e2532d0" containerID="65f699a14c30410a4c76d4ab7314f7aa92a40dc1b67c1c0bbabc6e62f24913c6" exitCode=255 Jun 13 02:03:21.108834 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.108740 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" event={"ID":"48dda147-3844-4dd4-9f0e-e74d0e2532d0","Type":"ContainerDied","Data":"65f699a14c30410a4c76d4ab7314f7aa92a40dc1b67c1c0bbabc6e62f24913c6"} Jun 13 02:03:21.109011 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.108999 2546 scope.go:117] "RemoveContainer" containerID="65f699a14c30410a4c76d4ab7314f7aa92a40dc1b67c1c0bbabc6e62f24913c6" Jun 13 02:03:21.753036 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:21.752994 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:03:22.114187 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:22.114107 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" event={"ID":"9d5a9aed-881c-4d1b-b942-61cd7844e22a","Type":"ContainerStarted","Data":"eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085"} Jun 13 02:03:22.114616 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:22.114273 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:03:22.114974 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:22.114953 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:03:22.115818 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:22.115767 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" event={"ID":"48dda147-3844-4dd4-9f0e-e74d0e2532d0","Type":"ContainerStarted","Data":"9d911a3f9d321a7a277d95bde974ae8eea6e87484cb9ef47bdac17ec48881199"} Jun 13 02:03:29.390800 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:29.390747 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:03:50.879888 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:03:50.879857 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:30.813924 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:30.813888 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:30.886992 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:30.886962 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:30.998443 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:30.998410 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:31.049511 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:31.049476 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:32.747596 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:32.747558 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:32.794561 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:32.794533 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:34.266922 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.266882 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fcnm8"] Jun 13 02:04:34.269845 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.269830 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.274100 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.274018 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 02:04:34.274100 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.274092 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 02:04:34.274297 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.274239 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6pdp8\"" Jun 13 02:04:34.275142 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.275122 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 02:04:34.275213 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.275145 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 02:04:34.277849 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.277828 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.277926 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.277871 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-crio-socket\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.277926 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.277902 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-data-volume\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.278008 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.277969 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.278008 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.277992 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj987\" (UniqueName: \"kubernetes.io/projected/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-api-access-mj987\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.287358 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.287339 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fcnm8"] Jun 13 02:04:34.315900 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.315871 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:34.366224 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.366195 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:34.378404 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378379 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj987\" (UniqueName: \"kubernetes.io/projected/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-api-access-mj987\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.378509 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378463 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.378509 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378495 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-crio-socket\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.378604 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378522 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-data-volume\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.378656 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378613 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-crio-socket\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.378656 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378631 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.378840 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.378825 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-data-volume\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.380622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.380606 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 02:04:34.380799 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.380761 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 02:04:34.385161 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.385147 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 02:04:34.389020 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.389007 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:34.389066 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.389060 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.88904637 +0000 UTC m=+240.836731273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : configmap "kube-rbac-proxy" not found Jun 13 02:04:34.389112 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.389092 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.389144 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.389139 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.889127588 +0000 UTC m=+240.836812486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.395327 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.395302 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 02:04:34.405933 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.405915 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj987\" (UniqueName: \"kubernetes.io/projected/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-api-access-mj987\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.756005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.755976 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:34.852390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.852360 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:34.950050 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.950014 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:34.982296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.982271 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.982408 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.982384 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:34.982456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:34.982423 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:34.982456 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.982445 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:35.982430203 +0000 UTC m=+241.930115101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : configmap "kube-rbac-proxy" not found Jun 13 02:04:34.982540 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.982497 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.982540 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:34.982539 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:35.982527958 +0000 UTC m=+241.930212856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:35.053846 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.053750 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:35.220239 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.220213 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:35.272866 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.272835 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:35.700311 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.700279 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:35.750912 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.750882 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:35.990736 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.990702 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:35.990929 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:35.990766 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:35.990929 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:35.990875 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:35.990929 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:35.990876 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:35.991037 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:35.990935 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:37.990915174 +0000 UTC m=+243.938600073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : configmap "kube-rbac-proxy" not found Jun 13 02:04:35.991037 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:35.990948 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:37.990942229 +0000 UTC m=+243.938627127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:36.068669 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:36.068641 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bhs2f_40eab1e5-112f-4d65-8fe3-6d5b2105d482/dns-node-resolver/0.log" Jun 13 02:04:37.267718 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:37.267690 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbmxr_c95ab1a5-4d9e-4dcb-8147-5780720d018b/node-ca/0.log" Jun 13 02:04:37.318292 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:37.318260 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:37.461761 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:37.461731 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:37.513819 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:37.513768 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:38.005761 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:38.005731 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:38.005939 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:38.005794 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:38.005939 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:38.005856 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:38.005939 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:38.005870 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:38.005939 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:38.005932 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:42.005915612 +0000 UTC m=+247.953600510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:38.006083 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:38.005946 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:42.00593952 +0000 UTC m=+247.953624418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : configmap "kube-rbac-proxy" not found Jun 13 02:04:38.149459 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:38.149426 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:38.268670 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:38.268597 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r82jc_88f3e852-7672-494b-a76d-32aecbbea0da/serve-healthcheck-canary/0.log" Jun 13 02:04:39.121162 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.121128 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:39.171615 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.171589 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:39.240991 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.240955 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:39.340641 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.340609 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:39.389367 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.389295 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:39.568239 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.568212 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:39.749113 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:39.749086 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:40.450542 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:40.450514 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:40.741748 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:40.741719 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:41.148255 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:41.148176 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:41.345382 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:41.345353 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:41.545217 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:41.545185 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:41.959319 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:41.959242 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:42.038664 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:42.038629 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:42.038832 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:42.038689 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:42.038832 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:42.038761 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:42.038832 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:42.038769 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:42.038944 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:42.038838 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.038820518 +0000 UTC m=+255.986505416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : configmap "kube-rbac-proxy" not found Jun 13 02:04:42.038944 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:42.038852 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls podName:f23bdb4a-d2e0-4cba-bd50-4f5a359a898d nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.038846187 +0000 UTC m=+255.986531085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fcnm8" (UID: "f23bdb4a-d2e0-4cba-bd50-4f5a359a898d") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:42.544624 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:42.544592 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:42.853771 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:42.853696 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:42.954615 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:42.954584 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:43.054213 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:43.054185 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:43.346982 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:43.346937 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:43.540243 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:43.540213 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:43.941723 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:43.941694 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:44.349948 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:44.349914 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:44.746231 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:44.746197 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:44.847739 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:44.847706 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:45.345964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:45.345931 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:45.610845 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:45.610749 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:45.747741 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:45.747711 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:46.139185 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:46.139157 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:46.272533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:46.272490 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:04:46.272710 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:46.272636 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:04:46.272752 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:04:46.272711 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs podName:7038fe64-fb84-4da4-8d82-0b5e6c1c609d nodeName:}" failed. No retries permitted until 2026-06-13 02:06:48.272694182 +0000 UTC m=+374.220379083 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs") pod "network-metrics-daemon-dv4cc" (UID: "7038fe64-fb84-4da4-8d82-0b5e6c1c609d") : secret "metrics-daemon-secret" not found Jun 13 02:04:46.342362 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:46.342325 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:46.950714 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:46.950659 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:47.374678 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:47.374625 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:47.545141 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:47.545111 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:47.758652 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:47.758616 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:48.143585 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:48.143469 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:48.344540 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:48.344512 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:48.542337 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:48.542302 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:48.935679 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:48.935598 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:49.076071 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:49.076038 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:49.345714 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:49.345681 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:49.544834 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:49.544802 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:49.944244 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:49.944215 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:50.098583 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.098543 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:50.098772 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.098598 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:50.099114 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.099094 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:50.100928 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.100906 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f23bdb4a-d2e0-4cba-bd50-4f5a359a898d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcnm8\" (UID: \"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d\") " pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:50.140637 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.140608 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:50.181222 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.181195 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6pdp8\"" Jun 13 02:04:50.189171 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.189152 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fcnm8" Jun 13 02:04:50.308048 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.308022 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fcnm8"] Jun 13 02:04:50.310432 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:04:50.310403 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23bdb4a_d2e0_4cba_bd50_4f5a359a898d.slice/crio-934b7f6628b97581d4ca8b3a535b8291143aef26653edb5916d38b7a0c1ff006 WatchSource:0}: Error finding container 934b7f6628b97581d4ca8b3a535b8291143aef26653edb5916d38b7a0c1ff006: Status 404 returned error can't find the container with id 934b7f6628b97581d4ca8b3a535b8291143aef26653edb5916d38b7a0c1ff006 Jun 13 02:04:50.366228 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:50.366192 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcnm8" event={"ID":"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d","Type":"ContainerStarted","Data":"934b7f6628b97581d4ca8b3a535b8291143aef26653edb5916d38b7a0c1ff006"} Jun 13 02:04:54.380758 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:54.380729 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcnm8" event={"ID":"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d","Type":"ContainerStarted","Data":"1c99b4b716fbab6f1a5bf5bd5dc7b055c19abdf1c7452db47801366b0a5c78e5"} Jun 13 02:04:55.386363 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:55.386331 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcnm8" event={"ID":"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d","Type":"ContainerStarted","Data":"05dedbb03c6f852a7746ffbe31a45ffa5aab394265423eb7ed74118d1e5a21ff"} Jun 13 02:04:56.393447 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:56.393359 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcnm8" event={"ID":"f23bdb4a-d2e0-4cba-bd50-4f5a359a898d","Type":"ContainerStarted","Data":"86954d923c896f0c8eedbe31c25350b14fc181b4e72b42ce1416c42436c4b092"} Jun 13 02:04:56.408138 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:56.408091 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fcnm8" podStartSLOduration=16.814111335 podStartE2EDuration="22.408076667s" totalImagesPullingTime="5.593965332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:04:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:56.406464661 +0000 UTC m=+262.354149573" watchObservedRunningTime="2026-06-13 02:04:56.408076667 +0000 UTC m=+262.355761587" Jun 13 02:04:57.720904 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:57.720867 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:57.780325 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:57.780293 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:58.767233 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:58.767197 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:58.856883 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:58.856854 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:04:58.926816 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:04:58.926772 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:01.107268 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:01.107235 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:01.174170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:01.174122 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:01.476699 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:01.476614 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:03.758419 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:03.758382 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:04.884450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:04.884416 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:04.986135 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:04.986104 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.219134 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.219104 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.454645 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.454608 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.458338 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.458315 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c8j78"] Jun 13 02:05:06.461515 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.461496 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.463730 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.463704 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 02:05:06.463916 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.463855 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 02:05:06.464130 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.464100 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 02:05:06.464130 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.464123 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 02:05:06.464956 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.464933 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 02:05:06.464956 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.464947 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 02:05:06.465130 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.464937 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rj66z\"" Jun 13 02:05:06.526811 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.526771 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p9tt\" (UniqueName: \"kubernetes.io/projected/bf2b9fbf-8193-4b25-a75a-dd516afe9879-kube-api-access-9p9tt\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.526951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.526843 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2b9fbf-8193-4b25-a75a-dd516afe9879-metrics-client-ca\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.526951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.526865 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.526951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.526889 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-sys\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.526951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.526911 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-textfile\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.526951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.526944 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-root\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.527121 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.527039 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-tls\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.527121 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.527066 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-wtmp\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.527121 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.527087 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.545343 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.545308 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.628074 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628043 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-textfile\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628074 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628077 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-root\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628130 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-tls\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628147 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-wtmp\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628165 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628194 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p9tt\" (UniqueName: \"kubernetes.io/projected/bf2b9fbf-8193-4b25-a75a-dd516afe9879-kube-api-access-9p9tt\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628223 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2b9fbf-8193-4b25-a75a-dd516afe9879-metrics-client-ca\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628244 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628247 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-root\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628618 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:06.628278 2546 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 02:05:06.628618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628343 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-wtmp\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628618 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:06.628350 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-tls podName:bf2b9fbf-8193-4b25-a75a-dd516afe9879 nodeName:}" failed. No retries permitted until 2026-06-13 02:05:07.128330977 +0000 UTC m=+273.076015887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-tls") pod "node-exporter-c8j78" (UID: "bf2b9fbf-8193-4b25-a75a-dd516afe9879") : secret "node-exporter-tls" not found Jun 13 02:05:06.628618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628278 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-sys\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628481 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf2b9fbf-8193-4b25-a75a-dd516afe9879-sys\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628483 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-textfile\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628849 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628821 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-accelerators-collector-config\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.628949 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.628821 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2b9fbf-8193-4b25-a75a-dd516afe9879-metrics-client-ca\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.630618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.630594 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.636370 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.636343 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p9tt\" (UniqueName: \"kubernetes.io/projected/bf2b9fbf-8193-4b25-a75a-dd516afe9879-kube-api-access-9p9tt\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:06.645284 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.645264 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.745545 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.745514 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.797621 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.797550 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.899643 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.899607 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:06.999180 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:06.999149 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:07.097186 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.097109 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:07.132372 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.132341 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-tls\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:07.134565 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.134543 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2b9fbf-8193-4b25-a75a-dd516afe9879-node-exporter-tls\") pod \"node-exporter-c8j78\" (UID: \"bf2b9fbf-8193-4b25-a75a-dd516afe9879\") " pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:07.371002 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.370915 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c8j78" Jun 13 02:05:07.381574 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:05:07.381546 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2b9fbf_8193_4b25_a75a_dd516afe9879.slice/crio-4ebfd0ed5f11b36689063c21af6e97bb30b2fcf35832bdbe6c77c996d9427add WatchSource:0}: Error finding container 4ebfd0ed5f11b36689063c21af6e97bb30b2fcf35832bdbe6c77c996d9427add: Status 404 returned error can't find the container with id 4ebfd0ed5f11b36689063c21af6e97bb30b2fcf35832bdbe6c77c996d9427add Jun 13 02:05:07.422440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.422406 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8j78" event={"ID":"bf2b9fbf-8193-4b25-a75a-dd516afe9879","Type":"ContainerStarted","Data":"4ebfd0ed5f11b36689063c21af6e97bb30b2fcf35832bdbe6c77c996d9427add"} Jun 13 02:05:07.464755 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.464725 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:07.539007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.538977 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:07.793535 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:07.793503 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:08.427174 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:08.427140 2546 generic.go:356] "Generic (PLEG): container finished" podID="bf2b9fbf-8193-4b25-a75a-dd516afe9879" containerID="9306a952ce27d44b7fcfdc532ad4264d0169b006f7c30e5a691300f408f30d31" exitCode=0 Jun 13 02:05:08.427571 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:08.427202 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8j78" event={"ID":"bf2b9fbf-8193-4b25-a75a-dd516afe9879","Type":"ContainerDied","Data":"9306a952ce27d44b7fcfdc532ad4264d0169b006f7c30e5a691300f408f30d31"} Jun 13 02:05:08.637220 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:08.637191 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:08.736960 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:08.736929 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:09.365534 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.365505 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:09.431964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.431933 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8j78" event={"ID":"bf2b9fbf-8193-4b25-a75a-dd516afe9879","Type":"ContainerStarted","Data":"09b96a4bca3313a8c246e6481a9b90e076f5ac303d3c81f6c0fb5c9ad9008b71"} Jun 13 02:05:09.432311 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.431985 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c8j78" event={"ID":"bf2b9fbf-8193-4b25-a75a-dd516afe9879","Type":"ContainerStarted","Data":"ddcf3442a556686b7f5dfe4640247266403d0cb89ba20d4c737973100b02d9bb"} Jun 13 02:05:09.441646 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.441618 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:09.452003 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.451961 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c8j78" podStartSLOduration=2.528649865 podStartE2EDuration="3.451947507s" totalImagesPullingTime="861.809846ms" totalInitContainerRuntime="61.487796ms" isStatefulPod=true podCreationTimestamp="2026-06-13 02:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:09.450332312 +0000 UTC m=+275.398017232" watchObservedRunningTime="2026-06-13 02:05:09.451947507 +0000 UTC m=+275.399632428" Jun 13 02:05:09.549428 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.549395 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:09.643099 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:09.643016 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:11.234964 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:11.234935 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:11.408827 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:11.408775 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:12.593283 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:12.593243 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:18.116620 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:18.116582 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:18.162756 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:18.162723 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:19.092593 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:19.092537 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mfm6d" podUID="65a5d3e8-cb09-42a1-9431-5298d210dccf" Jun 13 02:05:19.092593 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:19.092549 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" Jun 13 02:05:19.462522 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:19.462441 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mfm6d" Jun 13 02:05:19.462913 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:19.462441 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:05:21.470632 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.470549 2546 generic.go:356] "Generic (PLEG): container finished" podID="9d5a9aed-881c-4d1b-b942-61cd7844e22a" containerID="eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085" exitCode=1 Jun 13 02:05:21.470632 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.470622 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" event={"ID":"9d5a9aed-881c-4d1b-b942-61cd7844e22a","Type":"ContainerDied","Data":"eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085"} Jun 13 02:05:21.471134 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.470672 2546 scope.go:117] "RemoveContainer" containerID="ca558cb27b7afe19d0249a9a45527c0fb4ecdf1afd751b66a7ba8cd7e221eb01" Jun 13 02:05:21.471134 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.471040 2546 scope.go:117] "RemoveContainer" containerID="eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085" Jun 13 02:05:21.471233 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:21.471217 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-58cdd56969-dgzlb_open-cluster-management-agent-addon(9d5a9aed-881c-4d1b-b942-61cd7844e22a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" podUID="9d5a9aed-881c-4d1b-b942-61cd7844e22a" Jun 13 02:05:21.472460 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.472435 2546 generic.go:356] "Generic (PLEG): container finished" podID="48dda147-3844-4dd4-9f0e-e74d0e2532d0" containerID="9d911a3f9d321a7a277d95bde974ae8eea6e87484cb9ef47bdac17ec48881199" exitCode=255 Jun 13 02:05:21.472551 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.472471 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" event={"ID":"48dda147-3844-4dd4-9f0e-e74d0e2532d0","Type":"ContainerDied","Data":"9d911a3f9d321a7a277d95bde974ae8eea6e87484cb9ef47bdac17ec48881199"} Jun 13 02:05:21.472749 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.472736 2546 scope.go:117] "RemoveContainer" containerID="9d911a3f9d321a7a277d95bde974ae8eea6e87484cb9ef47bdac17ec48881199" Jun 13 02:05:21.472931 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:21.472905 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-776c7868b6-msrpt_open-cluster-management-agent-addon(48dda147-3844-4dd4-9f0e-e74d0e2532d0)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" podUID="48dda147-3844-4dd4-9f0e-e74d0e2532d0" Jun 13 02:05:21.480437 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:21.480420 2546 scope.go:117] "RemoveContainer" containerID="65f699a14c30410a4c76d4ab7314f7aa92a40dc1b67c1c0bbabc6e62f24913c6" Jun 13 02:05:22.114871 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:22.114823 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:05:22.477088 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:22.477005 2546 scope.go:117] "RemoveContainer" containerID="eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085" Jun 13 02:05:22.477519 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:22.477170 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-58cdd56969-dgzlb_open-cluster-management-agent-addon(9d5a9aed-881c-4d1b-b942-61cd7844e22a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" podUID="9d5a9aed-881c-4d1b-b942-61cd7844e22a" Jun 13 02:05:22.954887 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:22.954853 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:05:22.957209 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:22.957187 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"image-registry-7f8d6d6c8-47ld6\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:05:23.055389 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.055353 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:05:23.057584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.057563 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65a5d3e8-cb09-42a1-9431-5298d210dccf-metrics-tls\") pod \"dns-default-mfm6d\" (UID: \"65a5d3e8-cb09-42a1-9431-5298d210dccf\") " pod="openshift-dns/dns-default-mfm6d" Jun 13 02:05:23.067188 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.067166 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x269m\"" Jun 13 02:05:23.067325 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.067177 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc58g\"" Jun 13 02:05:23.074159 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.074138 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:05:23.074247 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.074219 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mfm6d" Jun 13 02:05:23.210876 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.210852 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f8d6d6c8-47ld6"] Jun 13 02:05:23.213211 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:05:23.213182 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a59b0f3_54cf_4de6_87a2_37a107a9a96e.slice/crio-4155f4988d3d8e2a678470a29285ae0555f4f84f706f39dba9c8e6a8332aca74 WatchSource:0}: Error finding container 4155f4988d3d8e2a678470a29285ae0555f4f84f706f39dba9c8e6a8332aca74: Status 404 returned error can't find the container with id 4155f4988d3d8e2a678470a29285ae0555f4f84f706f39dba9c8e6a8332aca74 Jun 13 02:05:23.221438 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.221412 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mfm6d"] Jun 13 02:05:23.225807 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.225774 2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:05:23.228114 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:05:23.228085 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a5d3e8_cb09_42a1_9431_5298d210dccf.slice/crio-6d064df190f73e2ab99b13c4f01ec36859609530b43639326b3653756eac3f7a WatchSource:0}: Error finding container 6d064df190f73e2ab99b13c4f01ec36859609530b43639326b3653756eac3f7a: Status 404 returned error can't find the container with id 6d064df190f73e2ab99b13c4f01ec36859609530b43639326b3653756eac3f7a Jun 13 02:05:23.265990 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.265955 2546 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" podUID="3926f067-735b-48af-807c-c7995e39163c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 02:05:23.271209 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.271186 2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" Jun 13 02:05:23.271547 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.271534 2546 scope.go:117] "RemoveContainer" containerID="9d911a3f9d321a7a277d95bde974ae8eea6e87484cb9ef47bdac17ec48881199" Jun 13 02:05:23.271718 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:23.271696 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-776c7868b6-msrpt_open-cluster-management-agent-addon(48dda147-3844-4dd4-9f0e-e74d0e2532d0)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" podUID="48dda147-3844-4dd4-9f0e-e74d0e2532d0" Jun 13 02:05:23.483310 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.483263 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" event={"ID":"9a59b0f3-54cf-4de6-87a2-37a107a9a96e","Type":"ContainerStarted","Data":"a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f"} Jun 13 02:05:23.483760 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.483319 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" event={"ID":"9a59b0f3-54cf-4de6-87a2-37a107a9a96e","Type":"ContainerStarted","Data":"4155f4988d3d8e2a678470a29285ae0555f4f84f706f39dba9c8e6a8332aca74"} Jun 13 02:05:23.483760 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.483348 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:05:23.484561 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.484536 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mfm6d" event={"ID":"65a5d3e8-cb09-42a1-9431-5298d210dccf","Type":"ContainerStarted","Data":"6d064df190f73e2ab99b13c4f01ec36859609530b43639326b3653756eac3f7a"} Jun 13 02:05:23.489035 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.485643 2546 scope.go:117] "RemoveContainer" containerID="eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085" Jun 13 02:05:23.489035 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:23.485958 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-58cdd56969-dgzlb_open-cluster-management-agent-addon(9d5a9aed-881c-4d1b-b942-61cd7844e22a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" podUID="9d5a9aed-881c-4d1b-b942-61cd7844e22a" Jun 13 02:05:23.504181 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:23.504133 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" podStartSLOduration=289.504118712 podStartE2EDuration="4m49.504118712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:23.503422041 +0000 UTC m=+289.451106980" watchObservedRunningTime="2026-06-13 02:05:23.504118712 +0000 UTC m=+289.451803631" Jun 13 02:05:25.492858 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:25.492806 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mfm6d" event={"ID":"65a5d3e8-cb09-42a1-9431-5298d210dccf","Type":"ContainerStarted","Data":"f095ccb033535eb9efe9b8dda1b0310cbf9fec7d39d6e567047e727cc4c415f4"} Jun 13 02:05:25.493269 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:25.492886 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mfm6d" event={"ID":"65a5d3e8-cb09-42a1-9431-5298d210dccf","Type":"ContainerStarted","Data":"09c5ecb735f802b06d5aa06514f5b1ded68d7456a15c0f3b8ecfcc67f291ef58"} Jun 13 02:05:25.493269 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:25.492933 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mfm6d" Jun 13 02:05:25.508584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:25.508543 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mfm6d" podStartSLOduration=251.581602322 podStartE2EDuration="4m13.508529026s" totalImagesPullingTime="1.926926704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:25.507369811 +0000 UTC m=+291.455054733" watchObservedRunningTime="2026-06-13 02:05:25.508529026 +0000 UTC m=+291.456213946" Jun 13 02:05:27.329886 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.329849 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:27.383337 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.383309 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:27.434315 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.434279 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:27.598978 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.598906 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:27.790142 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.790112 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:27.842959 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.842928 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:27.980681 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:27.980656 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:28.035063 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:28.035031 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:28.184288 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:28.184260 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:28.239336 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:28.239252 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:28.989799 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:28.989757 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:29.395352 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:29.395281 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:29.912933 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:29.912892 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:30.206014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:30.205938 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:30.259564 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:30.259529 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:32.391288 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:05:32.391250 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dv4cc" podUID="7038fe64-fb84-4da4-8d82-0b5e6c1c609d" Jun 13 02:05:33.265719 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:33.265685 2546 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" podUID="3926f067-735b-48af-807c-c7995e39163c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 02:05:34.349131 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:34.349106 2546 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 02:05:35.391672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:35.391640 2546 scope.go:117] "RemoveContainer" containerID="9d911a3f9d321a7a277d95bde974ae8eea6e87484cb9ef47bdac17ec48881199" Jun 13 02:05:35.498672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:35.498644 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mfm6d" Jun 13 02:05:35.529304 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:35.529271 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-776c7868b6-msrpt" event={"ID":"48dda147-3844-4dd4-9f0e-e74d0e2532d0","Type":"ContainerStarted","Data":"4ac28a48824235f1e4113b249aa9a33c81e9b057a158c35b38ba1e033b3ee92f"} Jun 13 02:05:36.391440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:36.391410 2546 scope.go:117] "RemoveContainer" containerID="eb8be2763c7f7b7a405cd0c6e6378472aceac97610253e4c731cd73707999085" Jun 13 02:05:36.536932 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:36.536897 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" event={"ID":"9d5a9aed-881c-4d1b-b942-61cd7844e22a","Type":"ContainerStarted","Data":"b9a58619d024f00580c620d757c42ffc006b98ac0ff1ad36ebc8acaef1b2db4e"} Jun 13 02:05:36.537388 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:36.537164 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:05:36.538457 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:36.538439 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58cdd56969-dgzlb" Jun 13 02:05:42.714336 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:42.714305 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:43.078361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.078320 2546 patch_prober.go:28] interesting pod/image-registry-7f8d6d6c8-47ld6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:43.078517 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.078372 2546 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:43.265626 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.265592 2546 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" podUID="3926f067-735b-48af-807c-c7995e39163c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 02:05:43.265772 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.265658 2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" Jun 13 02:05:43.266270 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.266226 2546 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0046e00732100a3da3db059be877094dca0e35149879405082128374927ce5fb"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 13 02:05:43.266308 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.266295 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" podUID="3926f067-735b-48af-807c-c7995e39163c" containerName="service-proxy" containerID="cri-o://0046e00732100a3da3db059be877094dca0e35149879405082128374927ce5fb" gracePeriod=30 Jun 13 02:05:43.560662 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.560627 2546 generic.go:356] "Generic (PLEG): container finished" podID="3926f067-735b-48af-807c-c7995e39163c" containerID="0046e00732100a3da3db059be877094dca0e35149879405082128374927ce5fb" exitCode=2 Jun 13 02:05:43.560844 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.560686 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" event={"ID":"3926f067-735b-48af-807c-c7995e39163c","Type":"ContainerDied","Data":"0046e00732100a3da3db059be877094dca0e35149879405082128374927ce5fb"} Jun 13 02:05:43.560844 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.560735 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5489cc949b-x59s4" event={"ID":"3926f067-735b-48af-807c-c7995e39163c","Type":"ContainerStarted","Data":"50f6cdd2da6e2b8a2298dd65b4d7bced7cf8c75d0435e9b0848b1ea5fb4db255"} Jun 13 02:05:43.673412 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:43.673338 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:44.491998 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:44.491969 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:05:44.605072 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:44.605044 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:44.651797 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:44.651739 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:44.776020 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:44.775947 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:44.878269 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:44.878241 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:46.391028 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:46.390989 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:05:47.407437 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:47.407403 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:47.459690 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:47.459661 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:49.206268 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:49.206234 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f8d6d6c8-47ld6"] Jun 13 02:05:49.283699 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:49.283668 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:49.381642 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:49.381612 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:51.218991 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:51.218958 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:51.269342 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:51.269313 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:51.809961 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:51.809931 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:51.913238 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:51.913199 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:52.010877 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:52.010835 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:52.111298 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:52.111220 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:57.722831 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:57.722773 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:57.823361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:57.823312 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:57.924110 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:57.924081 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:59.208915 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:59.208869 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:59.254488 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:59.254462 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:59.635916 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:59.635882 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:05:59.732476 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:05:59.732451 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:00.028414 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:00.028387 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:00.102482 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:00.102455 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:01.057068 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:01.057036 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:01.108502 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:01.108470 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:02.645101 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:02.645073 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:02.747900 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:02.747868 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:04.068208 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:04.068182 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8j78_bf2b9fbf-8193-4b25-a75a-dd516afe9879/init-textfile/0.log" Jun 13 02:06:04.266698 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:04.266670 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8j78_bf2b9fbf-8193-4b25-a75a-dd516afe9879/node-exporter/0.log" Jun 13 02:06:04.464627 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:04.464553 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8j78_bf2b9fbf-8193-4b25-a75a-dd516afe9879/kube-rbac-proxy/0.log" Jun 13 02:06:06.092256 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:06.092227 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:06.195234 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:06.195203 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:11.466262 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:11.466237 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r82jc_88f3e852-7672-494b-a76d-32aecbbea0da/serve-healthcheck-canary/0.log" Jun 13 02:06:12.713654 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:12.713622 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:12.777164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:12.777133 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:14.230857 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:14.230813 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerName="registry" containerID="cri-o://a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f" gracePeriod=30 Jun 13 02:06:14.488390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:14.488305 2546 patch_prober.go:28] interesting pod/image-registry-7f8d6d6c8-47ld6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 13 02:06:14.488390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:14.488377 2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 13 02:06:14.938832 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:14.938727 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:15.037323 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.037293 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:15.086105 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.086054 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:15.474764 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.474741 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:06:15.551640 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551614 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-trusted-ca\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.551751 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551661 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kknfs\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-kube-api-access-kknfs\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.551751 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551680 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-certificates\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.551751 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551702 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-bound-sa-token\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.551933 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551856 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-installation-pull-secrets\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.551933 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551916 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-image-registry-private-configuration\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.552039 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551953 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.552039 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.551985 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-ca-trust-extracted\") pod \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\" (UID: \"9a59b0f3-54cf-4de6-87a2-37a107a9a96e\") " Jun 13 02:06:15.552160 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.552136 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:15.552216 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.552151 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:15.552312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.552269 2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-trusted-ca\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.552312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.552294 2546 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-certificates\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.554284 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.554235 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:15.554413 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.554341 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:15.554472 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.554455 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-kube-api-access-kknfs" (OuterVolumeSpecName: "kube-api-access-kknfs") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "kube-api-access-kknfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:15.554550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.554527 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:15.554651 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.554552 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:15.560716 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.560695 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9a59b0f3-54cf-4de6-87a2-37a107a9a96e" (UID: "9a59b0f3-54cf-4de6-87a2-37a107a9a96e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:06:15.652977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.652895 2546 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-ca-trust-extracted\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.652977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.652921 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kknfs\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-kube-api-access-kknfs\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.652977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.652930 2546 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-bound-sa-token\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.652977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.652938 2546 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-installation-pull-secrets\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.652977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.652949 2546 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-image-registry-private-configuration\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.652977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.652958 2546 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a59b0f3-54cf-4de6-87a2-37a107a9a96e-registry-tls\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:06:15.671695 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.671663 2546 generic.go:356] "Generic (PLEG): container finished" podID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerID="a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f" exitCode=0 Jun 13 02:06:15.671850 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.671712 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" Jun 13 02:06:15.671850 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.671741 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" event={"ID":"9a59b0f3-54cf-4de6-87a2-37a107a9a96e","Type":"ContainerDied","Data":"a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f"} Jun 13 02:06:15.671850 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.671798 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f8d6d6c8-47ld6" event={"ID":"9a59b0f3-54cf-4de6-87a2-37a107a9a96e","Type":"ContainerDied","Data":"4155f4988d3d8e2a678470a29285ae0555f4f84f706f39dba9c8e6a8332aca74"} Jun 13 02:06:15.671850 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.671820 2546 scope.go:117] "RemoveContainer" containerID="a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f" Jun 13 02:06:15.679904 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.679884 2546 scope.go:117] "RemoveContainer" containerID="a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f" Jun 13 02:06:15.680145 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:06:15.680126 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f\": container with ID starting with a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f not found: ID does not exist" containerID="a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f" Jun 13 02:06:15.680184 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.680154 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f"} err="failed to get container status \"a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f\": rpc error: code = NotFound desc = could not find container \"a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f\": container with ID starting with a64ebd460cf790e8c9e6ce889bf7b86453c39e6452919b96c93ee925f85ff98f not found: ID does not exist" Jun 13 02:06:15.692155 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.692132 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f8d6d6c8-47ld6"] Jun 13 02:06:15.697464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:15.697443 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f8d6d6c8-47ld6"] Jun 13 02:06:16.395144 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:16.395115 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" path="/var/lib/kubelet/pods/9a59b0f3-54cf-4de6-87a2-37a107a9a96e/volumes" Jun 13 02:06:22.490283 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:22.490201 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:22.590718 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:22.590689 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:26.964100 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:26.964062 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:27.013963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:27.013929 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:27.558562 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:27.558534 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:27.606547 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:27.606520 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:27.715682 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:27.715653 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:27.814466 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:27.814380 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:36.301394 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:36.301360 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:36.347139 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:36.347109 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:38.393525 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:38.393491 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:38.442265 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:38.442236 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:38.497844 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:38.497810 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:38.596301 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:38.596271 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:42.726296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:42.726262 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:42.822328 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:42.822288 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:48.283822 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.283764 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:06:48.285963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.285943 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7038fe64-fb84-4da4-8d82-0b5e6c1c609d-metrics-certs\") pod \"network-metrics-daemon-dv4cc\" (UID: \"7038fe64-fb84-4da4-8d82-0b5e6c1c609d\") " pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:06:48.494252 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.494222 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sngzk\"" Jun 13 02:06:48.502182 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.502161 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4cc" Jun 13 02:06:48.620852 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.620828 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dv4cc"] Jun 13 02:06:48.623219 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:06:48.623193 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7038fe64_fb84_4da4_8d82_0b5e6c1c609d.slice/crio-7cc5eca7768a792b372df125db8d2023465558ac611ccecfce171d9233c4fa74 WatchSource:0}: Error finding container 7cc5eca7768a792b372df125db8d2023465558ac611ccecfce171d9233c4fa74: Status 404 returned error can't find the container with id 7cc5eca7768a792b372df125db8d2023465558ac611ccecfce171d9233c4fa74 Jun 13 02:06:48.625070 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.625056 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:06:48.780907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:48.780864 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dv4cc" event={"ID":"7038fe64-fb84-4da4-8d82-0b5e6c1c609d","Type":"ContainerStarted","Data":"7cc5eca7768a792b372df125db8d2023465558ac611ccecfce171d9233c4fa74"} Jun 13 02:06:50.788835 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:50.788776 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dv4cc" event={"ID":"7038fe64-fb84-4da4-8d82-0b5e6c1c609d","Type":"ContainerStarted","Data":"73f99d1edfb4bc94cdf18ccee3e025391d5842cb822cd37574f922f217d3cad7"} Jun 13 02:06:50.789223 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:50.788857 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dv4cc" event={"ID":"7038fe64-fb84-4da4-8d82-0b5e6c1c609d","Type":"ContainerStarted","Data":"dd456784de29504844f1921c89c305b8e8cf29807df64be86a70e827a68035c0"} Jun 13 02:06:50.805799 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:50.805701 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dv4cc" podStartSLOduration=375.647457298 podStartE2EDuration="6m16.805686362s" totalImagesPullingTime="1.158229064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:06:50.804366967 +0000 UTC m=+376.752051887" watchObservedRunningTime="2026-06-13 02:06:50.805686362 +0000 UTC m=+376.753371281" Jun 13 02:06:50.923868 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:50.923836 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:06:50.972357 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:06:50.972331 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:22.176561 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:22.176530 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:22.230751 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:22.230718 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:25.393159 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:25.393125 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:25.494437 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:25.494401 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:29.620003 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:29.619939 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:38.040079 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:38.040034 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:51.668763 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:51.668670 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:53.102422 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:53.102386 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:55.274448 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:55.274409 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:55.375040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:55.375008 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:56.212157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:56.212121 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:56.315342 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:56.315311 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:57.024256 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:57.024230 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:57.117672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:57.117641 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:59.521512 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:59.521473 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:07:59.804391 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:07:59.804308 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:00.105654 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:00.105545 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:02.260234 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:02.260206 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:02.313861 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:02.313824 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:04.297899 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.297865 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m"] Jun 13 02:08:04.298275 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.298112 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerName="registry" Jun 13 02:08:04.298275 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.298122 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerName="registry" Jun 13 02:08:04.298275 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.298169 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a59b0f3-54cf-4de6-87a2-37a107a9a96e" containerName="registry" Jun 13 02:08:04.300866 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.300840 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.303237 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.303215 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 02:08:04.303361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.303295 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 02:08:04.304250 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.304234 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xfgk7\"" Jun 13 02:08:04.307903 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.307882 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m"] Jun 13 02:08:04.401956 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.401927 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2cf9m\" (UID: \"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.401956 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.401958 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5bf\" (UniqueName: \"kubernetes.io/projected/ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2-kube-api-access-lh5bf\") pod \"cert-manager-cainjector-5d99449ffd-2cf9m\" (UID: \"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.503218 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.503189 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2cf9m\" (UID: \"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.503218 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.503221 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5bf\" (UniqueName: \"kubernetes.io/projected/ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2-kube-api-access-lh5bf\") pod \"cert-manager-cainjector-5d99449ffd-2cf9m\" (UID: \"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.511521 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.511498 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2cf9m\" (UID: \"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.511883 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.511866 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5bf\" (UniqueName: \"kubernetes.io/projected/ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2-kube-api-access-lh5bf\") pod \"cert-manager-cainjector-5d99449ffd-2cf9m\" (UID: \"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.610301 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.610221 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" Jun 13 02:08:04.730620 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:04.730588 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m"] Jun 13 02:08:04.733551 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:08:04.733523 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca6d5a06_6c71_4bd5_8feb_fb726f8ee3d2.slice/crio-1c75b5f34c2cf20ab49e676642a7ab41b0e581b6069a626593996e3aa58fb793 WatchSource:0}: Error finding container 1c75b5f34c2cf20ab49e676642a7ab41b0e581b6069a626593996e3aa58fb793: Status 404 returned error can't find the container with id 1c75b5f34c2cf20ab49e676642a7ab41b0e581b6069a626593996e3aa58fb793 Jun 13 02:08:05.024746 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:05.024705 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" event={"ID":"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2","Type":"ContainerStarted","Data":"1c75b5f34c2cf20ab49e676642a7ab41b0e581b6069a626593996e3aa58fb793"} Jun 13 02:08:07.916687 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:07.916628 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:08.041117 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:08.040883 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" event={"ID":"ca6d5a06-6c71-4bd5-8feb-fb726f8ee3d2","Type":"ContainerStarted","Data":"9e468d6137f8f29898b0164df31d196bc8b7fd64b0279d6ed9918e8102a412e4"} Jun 13 02:08:08.054992 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:08.054864 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2cf9m" podStartSLOduration=1.113525038 podStartE2EDuration="4.054845852s" totalImagesPullingTime="2.941320814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:08.054560163 +0000 UTC m=+454.002245086" watchObservedRunningTime="2026-06-13 02:08:08.054845852 +0000 UTC m=+454.002530772" Jun 13 02:08:08.343240 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:08.343155 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:08.387485 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:08.387449 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:10.554888 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:10.554858 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:10.653743 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:10.653711 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:16.298900 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:16.298862 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:16.400308 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:16.400280 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:18.936480 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:18.936446 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:27.849980 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:27.849946 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:27.896948 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:27.896920 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:31.722034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:31.721992 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:31.812023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:31.811990 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:31.946112 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:31.946082 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.047026 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.046997 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.304911 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.304828 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.504348 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.504322 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.608299 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.608223 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.622838 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.622808 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s"] Jun 13 02:08:32.625872 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.625856 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.628298 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.628274 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 02:08:32.628414 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.628319 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 02:08:32.628592 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.628573 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5ldbz\"" Jun 13 02:08:32.628819 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.628805 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 02:08:32.628870 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.628847 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 02:08:32.646604 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.646583 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s"] Jun 13 02:08:32.735012 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.734980 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.807275 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.807243 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faa66887-7602-4fe2-ae76-fb235335c4ca-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.807412 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.807285 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faa66887-7602-4fe2-ae76-fb235335c4ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.807412 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.807313 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faa66887-7602-4fe2-ae76-fb235335c4ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.807412 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.807345 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faa66887-7602-4fe2-ae76-fb235335c4ca-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.807412 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.807369 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kvqb\" (UniqueName: \"kubernetes.io/projected/faa66887-7602-4fe2-ae76-fb235335c4ca-kube-api-access-4kvqb\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.839932 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.839902 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:32.908484 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.908399 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faa66887-7602-4fe2-ae76-fb235335c4ca-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.908484 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.908441 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kvqb\" (UniqueName: \"kubernetes.io/projected/faa66887-7602-4fe2-ae76-fb235335c4ca-kube-api-access-4kvqb\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.908484 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.908483 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faa66887-7602-4fe2-ae76-fb235335c4ca-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.908675 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.908506 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faa66887-7602-4fe2-ae76-fb235335c4ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.908675 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.908528 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faa66887-7602-4fe2-ae76-fb235335c4ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.908841 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.908823 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faa66887-7602-4fe2-ae76-fb235335c4ca-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.910979 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.910956 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faa66887-7602-4fe2-ae76-fb235335c4ca-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.911083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.910989 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faa66887-7602-4fe2-ae76-fb235335c4ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.911130 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.911097 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faa66887-7602-4fe2-ae76-fb235335c4ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.916281 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.916262 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kvqb\" (UniqueName: \"kubernetes.io/projected/faa66887-7602-4fe2-ae76-fb235335c4ca-kube-api-access-4kvqb\") pod \"opendatahub-operator-controller-manager-76bc779c54-s5q5s\" (UID: \"faa66887-7602-4fe2-ae76-fb235335c4ca\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.935901 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.935879 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:32.936397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:32.936372 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:33.042374 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:33.042337 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:33.061464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:33.061442 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s"] Jun 13 02:08:33.064049 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:08:33.064023 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa66887_7602_4fe2_ae76_fb235335c4ca.slice/crio-95c99c36ea03d88e53d333ce647987fc78c8a69c4b662039c90b78045de7f75a WatchSource:0}: Error finding container 95c99c36ea03d88e53d333ce647987fc78c8a69c4b662039c90b78045de7f75a: Status 404 returned error can't find the container with id 95c99c36ea03d88e53d333ce647987fc78c8a69c4b662039c90b78045de7f75a Jun 13 02:08:33.126883 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:33.126847 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" event={"ID":"faa66887-7602-4fe2-ae76-fb235335c4ca","Type":"ContainerStarted","Data":"95c99c36ea03d88e53d333ce647987fc78c8a69c4b662039c90b78045de7f75a"} Jun 13 02:08:33.135963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:33.135931 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:33.236982 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:33.236952 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:33.337096 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:33.337064 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:37.144834 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:37.144806 2546 generic.go:356] "Generic (PLEG): container finished" podID="faa66887-7602-4fe2-ae76-fb235335c4ca" containerID="b033d3765fae3a6152a3b59a24655d3eeb4d60cc317c602712f130002db12f74" exitCode=0 Jun 13 02:08:37.145154 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:37.144847 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" event={"ID":"faa66887-7602-4fe2-ae76-fb235335c4ca","Type":"ContainerDied","Data":"b033d3765fae3a6152a3b59a24655d3eeb4d60cc317c602712f130002db12f74"} Jun 13 02:08:37.182911 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:37.182880 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:37.280092 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:37.280065 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:38.150224 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:38.150181 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" event={"ID":"faa66887-7602-4fe2-ae76-fb235335c4ca","Type":"ContainerStarted","Data":"d99aced81c641d9ada4a6f6376888733832b4f957117575ee71886174a89631b"} Jun 13 02:08:38.150701 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:38.150301 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:38.173036 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:38.172979 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" podStartSLOduration=1.861575993 podStartE2EDuration="6.172959386s" totalImagesPullingTime="3.353138323s" totalInitContainerRuntime="958.24507ms" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:38.171515289 +0000 UTC m=+484.119200208" watchObservedRunningTime="2026-06-13 02:08:38.172959386 +0000 UTC m=+484.120644307" Jun 13 02:08:43.893664 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:43.893626 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:43.994663 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:43.994625 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:49.111845 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:49.111812 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:49.155550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:49.155521 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-s5q5s" Jun 13 02:08:49.179617 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:49.179587 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:51.359990 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.359955 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:51.461017 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.460981 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:51.709567 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.709485 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4"] Jun 13 02:08:51.712771 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.712745 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.717162 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.717139 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 02:08:51.717294 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.717252 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 02:08:51.717294 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.717147 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 02:08:51.717408 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.717186 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8zwl5\"" Jun 13 02:08:51.717408 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.717188 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 02:08:51.717408 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.717150 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:08:51.729151 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.729127 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4"] Jun 13 02:08:51.739835 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.739813 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmm5\" (UniqueName: \"kubernetes.io/projected/1f4929aa-e61e-46c9-8fef-8e90c925ce39-kube-api-access-gpmm5\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.739943 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.739844 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4929aa-e61e-46c9-8fef-8e90c925ce39-cert\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.739943 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.739862 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f4929aa-e61e-46c9-8fef-8e90c925ce39-manager-config\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.739943 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.739879 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f4929aa-e61e-46c9-8fef-8e90c925ce39-metrics-cert\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.840395 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.840362 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4929aa-e61e-46c9-8fef-8e90c925ce39-cert\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.840395 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.840400 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f4929aa-e61e-46c9-8fef-8e90c925ce39-manager-config\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.840636 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.840426 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f4929aa-e61e-46c9-8fef-8e90c925ce39-metrics-cert\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.840636 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.840487 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmm5\" (UniqueName: \"kubernetes.io/projected/1f4929aa-e61e-46c9-8fef-8e90c925ce39-kube-api-access-gpmm5\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.841172 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.841142 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f4929aa-e61e-46c9-8fef-8e90c925ce39-manager-config\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.842884 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.842856 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f4929aa-e61e-46c9-8fef-8e90c925ce39-metrics-cert\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.842993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.842884 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4929aa-e61e-46c9-8fef-8e90c925ce39-cert\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.851710 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.851678 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmm5\" (UniqueName: \"kubernetes.io/projected/1f4929aa-e61e-46c9-8fef-8e90c925ce39-kube-api-access-gpmm5\") pod \"lws-controller-manager-54784dbd95-xm7f4\" (UID: \"1f4929aa-e61e-46c9-8fef-8e90c925ce39\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:51.928741 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:51.928705 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:52.021700 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.021669 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:52.024546 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.024516 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:52.156739 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.156709 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4"] Jun 13 02:08:52.159460 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:08:52.159418 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4929aa_e61e_46c9_8fef_8e90c925ce39.slice/crio-2f2e54087f6cc8bade5017399093752fe9cf2dbdab6a99ae5920005bf2bb1df1 WatchSource:0}: Error finding container 2f2e54087f6cc8bade5017399093752fe9cf2dbdab6a99ae5920005bf2bb1df1: Status 404 returned error can't find the container with id 2f2e54087f6cc8bade5017399093752fe9cf2dbdab6a99ae5920005bf2bb1df1 Jun 13 02:08:52.196837 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.196805 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" event={"ID":"1f4929aa-e61e-46c9-8fef-8e90c925ce39","Type":"ContainerStarted","Data":"2f2e54087f6cc8bade5017399093752fe9cf2dbdab6a99ae5920005bf2bb1df1"} Jun 13 02:08:52.209951 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.209919 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:52.335940 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.335857 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:52.439907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:52.439873 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:08:56.212974 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:56.212935 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" event={"ID":"1f4929aa-e61e-46c9-8fef-8e90c925ce39","Type":"ContainerStarted","Data":"7b36a6d65ad74de125db038e83df7bc669f7a967f1ba31442dd2bb4c7165bb80"} Jun 13 02:08:56.213397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:56.213071 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:08:56.228823 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:08:56.228752 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" podStartSLOduration=2.089105688 podStartE2EDuration="5.228738021s" totalImagesPullingTime="3.139632333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:56.227682551 +0000 UTC m=+502.175367475" watchObservedRunningTime="2026-06-13 02:08:56.228738021 +0000 UTC m=+502.176422940" Jun 13 02:09:01.398538 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:01.398505 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:01.525091 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:01.525053 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:01.639005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:01.638969 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:01.722326 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:01.722248 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:01.821297 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:01.821267 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:02.141724 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:02.141693 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:02.207828 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:02.207775 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:02.987732 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:02.987700 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:06.678230 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:06.678199 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:06.778543 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:06.778512 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:07.218799 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:07.218749 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-xm7f4" Jun 13 02:09:08.829153 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:08.829123 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:08.878766 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:08.878728 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:14.585046 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:14.585007 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:14.678679 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:14.678638 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:15.703579 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:15.703550 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:16.512175 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:16.512143 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:16.615147 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:16.615113 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:17.186752 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.186715 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:17.318309 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.318271 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:17.389371 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.389336 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:17.607162 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.607132 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8459cf648c-gj7mc"] Jun 13 02:09:17.616653 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.616631 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.619201 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.619180 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 02:09:17.619361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.619180 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7wqr8\"" Jun 13 02:09:17.619443 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.619399 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8459cf648c-gj7mc"] Jun 13 02:09:17.628728 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.628703 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:17.728554 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.728524 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cpnv\" (UniqueName: \"kubernetes.io/projected/61f02555-7ddb-4d30-a7d0-082a7c208302-kube-api-access-8cpnv\") pod \"dashboard-redirect-8459cf648c-gj7mc\" (UID: \"61f02555-7ddb-4d30-a7d0-082a7c208302\") " pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.728732 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.728570 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/61f02555-7ddb-4d30-a7d0-082a7c208302-redirect-config\") pod \"dashboard-redirect-8459cf648c-gj7mc\" (UID: \"61f02555-7ddb-4d30-a7d0-082a7c208302\") " pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.829156 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.829118 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cpnv\" (UniqueName: \"kubernetes.io/projected/61f02555-7ddb-4d30-a7d0-082a7c208302-kube-api-access-8cpnv\") pod \"dashboard-redirect-8459cf648c-gj7mc\" (UID: \"61f02555-7ddb-4d30-a7d0-082a7c208302\") " pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.829336 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.829165 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/61f02555-7ddb-4d30-a7d0-082a7c208302-redirect-config\") pod \"dashboard-redirect-8459cf648c-gj7mc\" (UID: \"61f02555-7ddb-4d30-a7d0-082a7c208302\") " pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.829903 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.829884 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/61f02555-7ddb-4d30-a7d0-082a7c208302-redirect-config\") pod \"dashboard-redirect-8459cf648c-gj7mc\" (UID: \"61f02555-7ddb-4d30-a7d0-082a7c208302\") " pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.837584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.837550 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cpnv\" (UniqueName: \"kubernetes.io/projected/61f02555-7ddb-4d30-a7d0-082a7c208302-kube-api-access-8cpnv\") pod \"dashboard-redirect-8459cf648c-gj7mc\" (UID: \"61f02555-7ddb-4d30-a7d0-082a7c208302\") " pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:17.927735 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:17.927653 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" Jun 13 02:09:18.049799 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:18.049752 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8459cf648c-gj7mc"] Jun 13 02:09:18.052680 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:09:18.052655 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f02555_7ddb_4d30_a7d0_082a7c208302.slice/crio-2caa73beeb2595c35b4069d6d55fa06becfd6d53f2f748226cc7dd67eba66976 WatchSource:0}: Error finding container 2caa73beeb2595c35b4069d6d55fa06becfd6d53f2f748226cc7dd67eba66976: Status 404 returned error can't find the container with id 2caa73beeb2595c35b4069d6d55fa06becfd6d53f2f748226cc7dd67eba66976 Jun 13 02:09:18.291100 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:18.291059 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" event={"ID":"61f02555-7ddb-4d30-a7d0-082a7c208302","Type":"ContainerStarted","Data":"2caa73beeb2595c35b4069d6d55fa06becfd6d53f2f748226cc7dd67eba66976"} Jun 13 02:09:20.300517 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:20.300435 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" event={"ID":"61f02555-7ddb-4d30-a7d0-082a7c208302","Type":"ContainerStarted","Data":"bb1e29c98d102fd54a1912a1333c5eb8b21178859675b6176c4a4828a6a0fbcb"} Jun 13 02:09:20.317166 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:20.317118 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8459cf648c-gj7mc" podStartSLOduration=1.32281711 podStartE2EDuration="3.317099119s" totalImagesPullingTime="1.994282009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:20.31516459 +0000 UTC m=+526.262849510" watchObservedRunningTime="2026-06-13 02:09:20.317099119 +0000 UTC m=+526.264784039" Jun 13 02:09:27.379132 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:27.379093 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:27.477177 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:27.477147 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:33.698053 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:33.698020 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:33.798037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:33.798004 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:34.530142 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:34.530095 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:37.972577 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:37.972541 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:38.041075 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.041037 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:38.223558 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.223479 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx"] Jun 13 02:09:38.232189 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.232168 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.234828 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.234802 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 02:09:38.234956 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.234879 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 02:09:38.235037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.234972 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dftrk\"" Jun 13 02:09:38.235096 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.235072 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 02:09:38.239513 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.239494 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx"] Jun 13 02:09:38.247954 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.247932 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:38.281637 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281610 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b969c43-37a4-4433-bc68-3e601ab70184-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.281817 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281659 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x79c2\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-kube-api-access-x79c2\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.281817 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281707 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.281817 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281752 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.281817 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281809 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.282034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281834 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.282034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281858 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b969c43-37a4-4433-bc68-3e601ab70184-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.282034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281881 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.282034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.281986 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382658 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382628 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382666 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b969c43-37a4-4433-bc68-3e601ab70184-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382692 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x79c2\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-kube-api-access-x79c2\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382741 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382772 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382811 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.382878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382849 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383185 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382884 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b969c43-37a4-4433-bc68-3e601ab70184-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383185 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.382910 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383286 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.383249 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383492 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.383465 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.383489 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.383582 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.383824 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.383795 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b969c43-37a4-4433-bc68-3e601ab70184-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.385305 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.385278 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.385645 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.385623 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b969c43-37a4-4433-bc68-3e601ab70184-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.390677 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.390631 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x79c2\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-kube-api-access-x79c2\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.390953 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.390932 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.471586 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.471548 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:38.496383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.496352 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54"] Jun 13 02:09:38.501543 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.501526 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.510340 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.510318 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54"] Jun 13 02:09:38.543370 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.543336 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:38.584890 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.584858 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.584903 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/702bedec-ddd2-4186-9d50-eb6a0c23a777-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.584942 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.584975 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.585008 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.585042 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.585060 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.585113 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.585170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.585145 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f8gp\" (UniqueName: \"kubernetes.io/projected/702bedec-ddd2-4186-9d50-eb6a0c23a777-kube-api-access-7f8gp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.633125 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.633079 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:38.677662 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.677635 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx"] Jun 13 02:09:38.680375 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:09:38.680349 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b969c43_37a4_4433_bc68_3e601ab70184.slice/crio-c3f04039f9201634f5ccb569d751e65268b0fc43b1754fc0fe5aaabddb94a90d WatchSource:0}: Error finding container c3f04039f9201634f5ccb569d751e65268b0fc43b1754fc0fe5aaabddb94a90d: Status 404 returned error can't find the container with id c3f04039f9201634f5ccb569d751e65268b0fc43b1754fc0fe5aaabddb94a90d Jun 13 02:09:38.686427 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686384 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/702bedec-ddd2-4186-9d50-eb6a0c23a777-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686517 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686446 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686517 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686471 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686627 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686575 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686679 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686632 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686679 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686661 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686775 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686704 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686775 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686730 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f8gp\" (UniqueName: \"kubernetes.io/projected/702bedec-ddd2-4186-9d50-eb6a0c23a777-kube-api-access-7f8gp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686775 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686770 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.686950 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.686882 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.687222 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.687194 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/702bedec-ddd2-4186-9d50-eb6a0c23a777-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.687431 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.687392 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.687536 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.687441 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.687536 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.687486 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.688937 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.688917 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.689256 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.689237 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.693879 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.693862 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/702bedec-ddd2-4186-9d50-eb6a0c23a777-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.694145 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.694127 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f8gp\" (UniqueName: \"kubernetes.io/projected/702bedec-ddd2-4186-9d50-eb6a0c23a777-kube-api-access-7f8gp\") pod \"data-science-gateway-data-science-gateway-class-74759f9795dfq54\" (UID: \"702bedec-ddd2-4186-9d50-eb6a0c23a777\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.812535 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.812445 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:38.939550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:38.939525 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54"] Jun 13 02:09:38.941326 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:09:38.941303 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702bedec_ddd2_4186_9d50_eb6a0c23a777.slice/crio-06a58bd6ef5733447965a45b9f3bd4fde5d267154bc80e68d7725b8a150644a1 WatchSource:0}: Error finding container 06a58bd6ef5733447965a45b9f3bd4fde5d267154bc80e68d7725b8a150644a1: Status 404 returned error can't find the container with id 06a58bd6ef5733447965a45b9f3bd4fde5d267154bc80e68d7725b8a150644a1 Jun 13 02:09:39.368513 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:39.368474 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" event={"ID":"6b969c43-37a4-4433-bc68-3e601ab70184","Type":"ContainerStarted","Data":"c3f04039f9201634f5ccb569d751e65268b0fc43b1754fc0fe5aaabddb94a90d"} Jun 13 02:09:39.369618 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:39.369584 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" event={"ID":"702bedec-ddd2-4186-9d50-eb6a0c23a777","Type":"ContainerStarted","Data":"06a58bd6ef5733447965a45b9f3bd4fde5d267154bc80e68d7725b8a150644a1"} Jun 13 02:09:41.564475 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.564431 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:41.631641 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.631599 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:09:41.631734 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.631691 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:09:41.631734 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.631723 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:09:41.638273 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.638246 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:09:41.638361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.638302 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:09:41.638361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:41.638334 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:09:42.382223 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.382179 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" event={"ID":"6b969c43-37a4-4433-bc68-3e601ab70184","Type":"ContainerStarted","Data":"dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121"} Jun 13 02:09:42.383608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.383586 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" event={"ID":"702bedec-ddd2-4186-9d50-eb6a0c23a777","Type":"ContainerStarted","Data":"cd35fd705354a8e527aa4b85a83fd0eeb2c977790ac25ace99c367ab14d54351"} Jun 13 02:09:42.403033 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.402975 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" podStartSLOduration=1.4563860659999999 podStartE2EDuration="4.402958045s" totalImagesPullingTime="2.946571979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:42.401837543 +0000 UTC m=+548.349522473" watchObservedRunningTime="2026-06-13 02:09:42.402958045 +0000 UTC m=+548.350642965" Jun 13 02:09:42.420312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.420254 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" podStartSLOduration=1.725449177 podStartE2EDuration="4.420234339s" totalImagesPullingTime="2.694785162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:42.418627585 +0000 UTC m=+548.366312518" watchObservedRunningTime="2026-06-13 02:09:42.420234339 +0000 UTC m=+548.367919464" Jun 13 02:09:42.543738 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.543684 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:42.545287 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.545253 2546 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.17:15021/healthz/ready\": dial tcp 10.132.0.17:15021: connect: connection refused" start-of-body= Jun 13 02:09:42.545424 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.545303 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.17:15021/healthz/ready\": dial tcp 10.132.0.17:15021: connect: connection refused" Jun 13 02:09:42.813492 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.813453 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:42.818110 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:42.818082 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:43.388020 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:43.387987 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:43.388723 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:43.388705 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795dfq54" Jun 13 02:09:43.432403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:43.432373 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx"] Jun 13 02:09:43.544317 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:43.544282 2546 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.17:15021/healthz/ready\": dial tcp 10.132.0.17:15021: connect: connection refused" start-of-body= Jun 13 02:09:43.544482 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:43.544342 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.17:15021/healthz/ready\": dial tcp 10.132.0.17:15021: connect: connection refused" Jun 13 02:09:44.544186 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:44.544156 2546 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.17:15021/healthz/ready\": dial tcp 10.132.0.17:15021: connect: connection refused" start-of-body= Jun 13 02:09:44.544581 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:44.544203 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.17:15021/healthz/ready\": dial tcp 10.132.0.17:15021: connect: connection refused" Jun 13 02:09:45.396316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:45.396277 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" containerID="cri-o://dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121" gracePeriod=30 Jun 13 02:09:50.641705 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.641680 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:50.786888 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.786857 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b969c43-37a4-4433-bc68-3e601ab70184-istio-podinfo\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.786905 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x79c2\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-kube-api-access-x79c2\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.786952 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-socket\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.786981 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b969c43-37a4-4433-bc68-3e601ab70184-istiod-ca-cert\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.786999 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-credential-socket\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787036 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-data\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787083 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787081 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-envoy\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787123 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-istio-token\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787153 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-certs\") pod \"6b969c43-37a4-4433-bc68-3e601ab70184\" (UID: \"6b969c43-37a4-4433-bc68-3e601ab70184\") " Jun 13 02:09:50.787481 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787375 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:50.787481 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787396 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:50.787586 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787515 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:50.787586 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787526 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b969c43-37a4-4433-bc68-3e601ab70184-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:09:50.787658 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.787612 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:50.789284 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.789254 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b969c43-37a4-4433-bc68-3e601ab70184-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 02:09:50.789423 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.789288 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:09:50.789690 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.789663 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:09:50.789690 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.789666 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-kube-api-access-x79c2" (OuterVolumeSpecName: "kube-api-access-x79c2") pod "6b969c43-37a4-4433-bc68-3e601ab70184" (UID: "6b969c43-37a4-4433-bc68-3e601ab70184"). InnerVolumeSpecName "kube-api-access-x79c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:09:50.888516 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888475 2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-credential-socket\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888516 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888509 2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-data\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888516 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888519 2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-istio-envoy\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888516 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888527 2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-istio-token\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888535 2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-certs\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888542 2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b969c43-37a4-4433-bc68-3e601ab70184-istio-podinfo\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888550 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x79c2\" (UniqueName: \"kubernetes.io/projected/6b969c43-37a4-4433-bc68-3e601ab70184-kube-api-access-x79c2\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888559 2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b969c43-37a4-4433-bc68-3e601ab70184-workload-socket\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:50.888776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:50.888568 2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b969c43-37a4-4433-bc68-3e601ab70184-istiod-ca-cert\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:51.417749 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.417709 2546 generic.go:356] "Generic (PLEG): container finished" podID="6b969c43-37a4-4433-bc68-3e601ab70184" containerID="dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121" exitCode=0 Jun 13 02:09:51.417930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.417763 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" Jun 13 02:09:51.417930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.417808 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" event={"ID":"6b969c43-37a4-4433-bc68-3e601ab70184","Type":"ContainerDied","Data":"dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121"} Jun 13 02:09:51.417930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.417862 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx" event={"ID":"6b969c43-37a4-4433-bc68-3e601ab70184","Type":"ContainerDied","Data":"c3f04039f9201634f5ccb569d751e65268b0fc43b1754fc0fe5aaabddb94a90d"} Jun 13 02:09:51.417930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.417884 2546 scope.go:117] "RemoveContainer" containerID="dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121" Jun 13 02:09:51.426167 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.426150 2546 scope.go:117] "RemoveContainer" containerID="dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121" Jun 13 02:09:51.426416 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:09:51.426395 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121\": container with ID starting with dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121 not found: ID does not exist" containerID="dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121" Jun 13 02:09:51.426480 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.426429 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121"} err="failed to get container status \"dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121\": rpc error: code = NotFound desc = could not find container \"dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121\": container with ID starting with dc164aee5d61f03c1d35772fc59c9c834d398823700100bba9dbef9bd8c53121 not found: ID does not exist" Jun 13 02:09:51.438325 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.438305 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx"] Jun 13 02:09:51.442901 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:51.442883 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fsl8cx"] Jun 13 02:09:52.305330 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.305298 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:52.395967 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.395926 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" path="/var/lib/kubelet/pods/6b969c43-37a4-4433-bc68-3e601ab70184/volumes" Jun 13 02:09:52.402904 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.402881 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:52.438657 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.438619 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldvh4"] Jun 13 02:09:52.438950 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.438933 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" Jun 13 02:09:52.439037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.438952 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" Jun 13 02:09:52.439092 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.439041 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b969c43-37a4-4433-bc68-3e601ab70184" containerName="istio-proxy" Jun 13 02:09:52.450857 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.450827 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:52.452522 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.452495 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldvh4"] Jun 13 02:09:52.453596 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.453566 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 02:09:52.453596 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.453590 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 02:09:52.454755 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.454734 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4zqp5\"" Jun 13 02:09:52.503284 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.503255 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:09:52.603623 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.603542 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnc28\" (UniqueName: \"kubernetes.io/projected/a18adbad-0a85-4d53-b307-1a32890e28ea-kube-api-access-pnc28\") pod \"kuadrant-operator-catalog-ldvh4\" (UID: \"a18adbad-0a85-4d53-b307-1a32890e28ea\") " pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:52.704078 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.704045 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnc28\" (UniqueName: \"kubernetes.io/projected/a18adbad-0a85-4d53-b307-1a32890e28ea-kube-api-access-pnc28\") pod \"kuadrant-operator-catalog-ldvh4\" (UID: \"a18adbad-0a85-4d53-b307-1a32890e28ea\") " pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:52.712529 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.712502 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnc28\" (UniqueName: \"kubernetes.io/projected/a18adbad-0a85-4d53-b307-1a32890e28ea-kube-api-access-pnc28\") pod \"kuadrant-operator-catalog-ldvh4\" (UID: \"a18adbad-0a85-4d53-b307-1a32890e28ea\") " pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:52.762573 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.762537 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:52.809142 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.809107 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldvh4"] Jun 13 02:09:52.886427 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:52.886400 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldvh4"] Jun 13 02:09:52.889147 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:09:52.889124 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18adbad_0a85_4d53_b307_1a32890e28ea.slice/crio-8be6769832f13efc1e712d5abb9fbba61ea0776f5ed64665bb176a0f10320f23 WatchSource:0}: Error finding container 8be6769832f13efc1e712d5abb9fbba61ea0776f5ed64665bb176a0f10320f23: Status 404 returned error can't find the container with id 8be6769832f13efc1e712d5abb9fbba61ea0776f5ed64665bb176a0f10320f23 Jun 13 02:09:53.019673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.019629 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rqlc2"] Jun 13 02:09:53.024228 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.024206 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:09:53.029853 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.029827 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rqlc2"] Jun 13 02:09:53.106699 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.106664 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv5dw\" (UniqueName: \"kubernetes.io/projected/653f6be8-e6b6-40ea-9676-27d5cbf8b1cb-kube-api-access-fv5dw\") pod \"kuadrant-operator-catalog-rqlc2\" (UID: \"653f6be8-e6b6-40ea-9676-27d5cbf8b1cb\") " pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:09:53.208065 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.207981 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv5dw\" (UniqueName: \"kubernetes.io/projected/653f6be8-e6b6-40ea-9676-27d5cbf8b1cb-kube-api-access-fv5dw\") pod \"kuadrant-operator-catalog-rqlc2\" (UID: \"653f6be8-e6b6-40ea-9676-27d5cbf8b1cb\") " pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:09:53.215427 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.215397 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv5dw\" (UniqueName: \"kubernetes.io/projected/653f6be8-e6b6-40ea-9676-27d5cbf8b1cb-kube-api-access-fv5dw\") pod \"kuadrant-operator-catalog-rqlc2\" (UID: \"653f6be8-e6b6-40ea-9676-27d5cbf8b1cb\") " pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:09:53.334648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.334617 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:09:53.428337 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.428304 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" event={"ID":"a18adbad-0a85-4d53-b307-1a32890e28ea","Type":"ContainerStarted","Data":"8be6769832f13efc1e712d5abb9fbba61ea0776f5ed64665bb176a0f10320f23"} Jun 13 02:09:53.460906 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:53.460869 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rqlc2"] Jun 13 02:09:53.502739 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:09:53.502709 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653f6be8_e6b6_40ea_9676_27d5cbf8b1cb.slice/crio-9ebf3b8e60986efb6021caf32e81ba3296131b80af28796c88e5bff0fa206ce3 WatchSource:0}: Error finding container 9ebf3b8e60986efb6021caf32e81ba3296131b80af28796c88e5bff0fa206ce3: Status 404 returned error can't find the container with id 9ebf3b8e60986efb6021caf32e81ba3296131b80af28796c88e5bff0fa206ce3 Jun 13 02:09:54.434442 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:54.434407 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" event={"ID":"653f6be8-e6b6-40ea-9676-27d5cbf8b1cb","Type":"ContainerStarted","Data":"9ebf3b8e60986efb6021caf32e81ba3296131b80af28796c88e5bff0fa206ce3"} Jun 13 02:09:55.440294 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.440190 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" event={"ID":"a18adbad-0a85-4d53-b307-1a32890e28ea","Type":"ContainerStarted","Data":"31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5"} Jun 13 02:09:55.440294 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.440227 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" podUID="a18adbad-0a85-4d53-b307-1a32890e28ea" containerName="registry-server" containerID="cri-o://31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5" gracePeriod=2 Jun 13 02:09:55.441684 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.441656 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" event={"ID":"653f6be8-e6b6-40ea-9676-27d5cbf8b1cb","Type":"ContainerStarted","Data":"6d72cb191b43144e9cd24e4e039ddbd5c6be3dfffeef0a62a542eda8a8eecc09"} Jun 13 02:09:55.455943 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.455904 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" podStartSLOduration=1.308123313 podStartE2EDuration="3.455891304s" totalImagesPullingTime="2.147767991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:55.454174456 +0000 UTC m=+561.401859376" watchObservedRunningTime="2026-06-13 02:09:55.455891304 +0000 UTC m=+561.403576224" Jun 13 02:09:55.468541 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.468490 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" podStartSLOduration=0.931267637 podStartE2EDuration="2.468477492s" totalImagesPullingTime="1.537209855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:55.467603508 +0000 UTC m=+561.415288430" watchObservedRunningTime="2026-06-13 02:09:55.468477492 +0000 UTC m=+561.416162413" Jun 13 02:09:55.681899 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.681872 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:55.829000 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.828966 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnc28\" (UniqueName: \"kubernetes.io/projected/a18adbad-0a85-4d53-b307-1a32890e28ea-kube-api-access-pnc28\") pod \"a18adbad-0a85-4d53-b307-1a32890e28ea\" (UID: \"a18adbad-0a85-4d53-b307-1a32890e28ea\") " Jun 13 02:09:55.831116 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.831084 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18adbad-0a85-4d53-b307-1a32890e28ea-kube-api-access-pnc28" (OuterVolumeSpecName: "kube-api-access-pnc28") pod "a18adbad-0a85-4d53-b307-1a32890e28ea" (UID: "a18adbad-0a85-4d53-b307-1a32890e28ea"). InnerVolumeSpecName "kube-api-access-pnc28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:09:55.930257 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:55.930205 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnc28\" (UniqueName: \"kubernetes.io/projected/a18adbad-0a85-4d53-b307-1a32890e28ea-kube-api-access-pnc28\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:09:56.446942 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.446909 2546 generic.go:356] "Generic (PLEG): container finished" podID="a18adbad-0a85-4d53-b307-1a32890e28ea" containerID="31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5" exitCode=0 Jun 13 02:09:56.447324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.446952 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" Jun 13 02:09:56.447324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.447001 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" event={"ID":"a18adbad-0a85-4d53-b307-1a32890e28ea","Type":"ContainerDied","Data":"31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5"} Jun 13 02:09:56.447324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.447052 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ldvh4" event={"ID":"a18adbad-0a85-4d53-b307-1a32890e28ea","Type":"ContainerDied","Data":"8be6769832f13efc1e712d5abb9fbba61ea0776f5ed64665bb176a0f10320f23"} Jun 13 02:09:56.447324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.447073 2546 scope.go:117] "RemoveContainer" containerID="31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5" Jun 13 02:09:56.457071 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.457054 2546 scope.go:117] "RemoveContainer" containerID="31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5" Jun 13 02:09:56.457327 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:09:56.457304 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5\": container with ID starting with 31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5 not found: ID does not exist" containerID="31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5" Jun 13 02:09:56.457416 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.457333 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5"} err="failed to get container status \"31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5\": rpc error: code = NotFound desc = could not find container \"31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5\": container with ID starting with 31a8976777564bcff04ba266734d960fad24aa7fbd0bd0f6f434ec52907938c5 not found: ID does not exist" Jun 13 02:09:56.461320 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.461300 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldvh4"] Jun 13 02:09:56.465203 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:56.465180 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ldvh4"] Jun 13 02:09:58.395279 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:09:58.395246 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18adbad-0a85-4d53-b307-1a32890e28ea" path="/var/lib/kubelet/pods/a18adbad-0a85-4d53-b307-1a32890e28ea/volumes" Jun 13 02:10:03.334921 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:03.334872 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:10:03.335347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:03.334974 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:10:03.356971 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:03.356940 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:10:03.494393 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:03.494364 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rqlc2" Jun 13 02:10:20.820668 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:20.820620 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:21.612119 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:21.612081 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:24.674889 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.674856 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gdflp"] Jun 13 02:10:24.675303 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.675117 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18adbad-0a85-4d53-b307-1a32890e28ea" containerName="registry-server" Jun 13 02:10:24.675303 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.675128 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18adbad-0a85-4d53-b307-1a32890e28ea" containerName="registry-server" Jun 13 02:10:24.675303 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.675170 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18adbad-0a85-4d53-b307-1a32890e28ea" containerName="registry-server" Jun 13 02:10:24.677966 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.677951 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:24.680326 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.680300 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fjzgm\"" Jun 13 02:10:24.685807 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.685770 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gdflp"] Jun 13 02:10:24.747592 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.747556 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6htbc\" (UniqueName: \"kubernetes.io/projected/8775a8a9-31ed-46ee-a092-64329aa4ff25-kube-api-access-6htbc\") pod \"authorino-operator-75cc8d5cb7-gdflp\" (UID: \"8775a8a9-31ed-46ee-a092-64329aa4ff25\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:24.849006 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.848968 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6htbc\" (UniqueName: \"kubernetes.io/projected/8775a8a9-31ed-46ee-a092-64329aa4ff25-kube-api-access-6htbc\") pod \"authorino-operator-75cc8d5cb7-gdflp\" (UID: \"8775a8a9-31ed-46ee-a092-64329aa4ff25\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:24.883841 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.883813 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6htbc\" (UniqueName: \"kubernetes.io/projected/8775a8a9-31ed-46ee-a092-64329aa4ff25-kube-api-access-6htbc\") pod \"authorino-operator-75cc8d5cb7-gdflp\" (UID: \"8775a8a9-31ed-46ee-a092-64329aa4ff25\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:24.988478 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:24.988447 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:25.112072 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:25.112039 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gdflp"] Jun 13 02:10:25.115164 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:10:25.115133 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8775a8a9_31ed_46ee_a092_64329aa4ff25.slice/crio-02cee5fec55c3738d2613950b4e631c012df097909753555883ec31e8de4e2e4 WatchSource:0}: Error finding container 02cee5fec55c3738d2613950b4e631c012df097909753555883ec31e8de4e2e4: Status 404 returned error can't find the container with id 02cee5fec55c3738d2613950b4e631c012df097909753555883ec31e8de4e2e4 Jun 13 02:10:25.553202 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:25.553168 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" event={"ID":"8775a8a9-31ed-46ee-a092-64329aa4ff25","Type":"ContainerStarted","Data":"02cee5fec55c3738d2613950b4e631c012df097909753555883ec31e8de4e2e4"} Jun 13 02:10:25.608762 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:25.608728 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:27.564475 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:27.564446 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" event={"ID":"8775a8a9-31ed-46ee-a092-64329aa4ff25","Type":"ContainerStarted","Data":"22d7defa498493328dc29713e5cade783a8ba81730242780b8fb2d3585d57dac"} Jun 13 02:10:27.564869 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:27.564554 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:27.583814 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:27.583750 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" podStartSLOduration=1.360422354 podStartE2EDuration="3.583736223s" totalImagesPullingTime="2.223313869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:27.582989377 +0000 UTC m=+593.530674297" watchObservedRunningTime="2026-06-13 02:10:27.583736223 +0000 UTC m=+593.531421142" Jun 13 02:10:28.646464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:28.646431 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:28.705397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:28.705364 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:30.824451 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:30.824414 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:31.313108 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:31.313071 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:32.800770 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:32.800734 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8"] Jun 13 02:10:32.808183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:32.808160 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:32.811843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:32.811817 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g9ms8\"" Jun 13 02:10:32.812068 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:32.812046 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8"] Jun 13 02:10:32.902155 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:32.902128 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtxt\" (UniqueName: \"kubernetes.io/projected/f57b1738-3101-446e-ac5f-2326503a4c26-kube-api-access-sbtxt\") pod \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" (UID: \"f57b1738-3101-446e-ac5f-2326503a4c26\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:33.003465 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:33.003431 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtxt\" (UniqueName: \"kubernetes.io/projected/f57b1738-3101-446e-ac5f-2326503a4c26-kube-api-access-sbtxt\") pod \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" (UID: \"f57b1738-3101-446e-ac5f-2326503a4c26\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:33.015282 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:33.015250 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtxt\" (UniqueName: \"kubernetes.io/projected/f57b1738-3101-446e-ac5f-2326503a4c26-kube-api-access-sbtxt\") pod \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" (UID: \"f57b1738-3101-446e-ac5f-2326503a4c26\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:33.059694 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:33.059621 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:33.119533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:33.119507 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:33.249727 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:33.249705 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8"] Jun 13 02:10:33.252040 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:10:33.252013 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57b1738_3101_446e_ac5f_2326503a4c26.slice/crio-30631e823bba22a6fb70c2e63fac6a950c6ae43973dba2bb31d5145e33682270 WatchSource:0}: Error finding container 30631e823bba22a6fb70c2e63fac6a950c6ae43973dba2bb31d5145e33682270: Status 404 returned error can't find the container with id 30631e823bba22a6fb70c2e63fac6a950c6ae43973dba2bb31d5145e33682270 Jun 13 02:10:33.589682 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:33.589649 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" event={"ID":"f57b1738-3101-446e-ac5f-2326503a4c26","Type":"ContainerStarted","Data":"30631e823bba22a6fb70c2e63fac6a950c6ae43973dba2bb31d5145e33682270"} Jun 13 02:10:34.038967 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:34.038935 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:35.599115 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:35.599086 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" event={"ID":"f57b1738-3101-446e-ac5f-2326503a4c26","Type":"ContainerStarted","Data":"e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637"} Jun 13 02:10:35.601573 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:35.599194 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:35.616661 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:35.616615 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" podStartSLOduration=1.6704596870000001 podStartE2EDuration="3.616601659s" totalImagesPullingTime="1.946141972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:35.61544675 +0000 UTC m=+601.563131670" watchObservedRunningTime="2026-06-13 02:10:35.616601659 +0000 UTC m=+601.564286578" Jun 13 02:10:36.080129 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:36.080096 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:37.619440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:37.619409 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:37.674531 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:37.674500 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:38.018146 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:38.018119 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:38.118093 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:38.118055 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:38.570888 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:38.570860 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdflp" Jun 13 02:10:41.224563 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:41.224531 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:41.325577 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:41.325542 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:42.280177 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.280146 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m"] Jun 13 02:10:42.283227 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.283211 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.285533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.285508 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 13 02:10:42.285640 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.285536 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 13 02:10:42.285640 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.285508 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-46q98\"" Jun 13 02:10:42.290214 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.290038 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m"] Jun 13 02:10:42.293939 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.293910 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:42.379870 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.379837 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.380037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.379890 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.380037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.379916 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfrt6\" (UniqueName: \"kubernetes.io/projected/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-kube-api-access-dfrt6\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.484826 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.484765 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.485037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.484854 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.485037 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.484884 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfrt6\" (UniqueName: \"kubernetes.io/projected/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-kube-api-access-dfrt6\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.485037 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:42.484991 2546 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 13 02:10:42.485205 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:42.485070 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-plugin-serving-cert podName:2ca25a7d-1f08-4d53-9380-96fd2f2f4239 nodeName:}" failed. No retries permitted until 2026-06-13 02:10:42.985049156 +0000 UTC m=+608.932734070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-vs58m" (UID: "2ca25a7d-1f08-4d53-9380-96fd2f2f4239") : secret "plugin-serving-cert" not found Jun 13 02:10:42.485929 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.485906 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.495713 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.495685 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfrt6\" (UniqueName: \"kubernetes.io/projected/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-kube-api-access-dfrt6\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.679055 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.678966 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:42.990255 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.990225 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:42.992677 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:42.992657 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ca25a7d-1f08-4d53-9380-96fd2f2f4239-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs58m\" (UID: \"2ca25a7d-1f08-4d53-9380-96fd2f2f4239\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:43.193103 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:43.193071 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" Jun 13 02:10:43.194234 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:43.194203 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:43.295028 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:43.294990 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:43.315710 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:43.315688 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m"] Jun 13 02:10:43.317702 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:10:43.317677 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ca25a7d_1f08_4d53_9380_96fd2f2f4239.slice/crio-eac2e4ee275cc96eb27c678d5308f900f1073dc7902e9064f4e15a5e3eb902e9 WatchSource:0}: Error finding container eac2e4ee275cc96eb27c678d5308f900f1073dc7902e9064f4e15a5e3eb902e9: Status 404 returned error can't find the container with id eac2e4ee275cc96eb27c678d5308f900f1073dc7902e9064f4e15a5e3eb902e9 Jun 13 02:10:43.632724 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:43.632635 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" event={"ID":"2ca25a7d-1f08-4d53-9380-96fd2f2f4239","Type":"ContainerStarted","Data":"eac2e4ee275cc96eb27c678d5308f900f1073dc7902e9064f4e15a5e3eb902e9"} Jun 13 02:10:46.605866 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:46.605837 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:47.871444 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:47.871409 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:48.878456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:48.878422 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:50.340249 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:50.340213 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:50.440520 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:50.440487 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:52.727064 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:52.727027 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8"] Jun 13 02:10:52.727597 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:52.727299 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" containerName="manager" containerID="cri-o://e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637" gracePeriod=2 Jun 13 02:10:52.744491 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:52.744463 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8"] Jun 13 02:10:52.745057 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:52.745022 2546 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f57b1738-3101-446e-ac5f-2326503a4c26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-xp4w8\": pods \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:52.983270 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:52.983244 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:52.985692 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:52.985667 2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" is forbidden: User \"system:node:ip-10-0-134-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-133.ec2.internal' and this object" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:53.077977 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.077943 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbtxt\" (UniqueName: \"kubernetes.io/projected/f57b1738-3101-446e-ac5f-2326503a4c26-kube-api-access-sbtxt\") pod \"f57b1738-3101-446e-ac5f-2326503a4c26\" (UID: \"f57b1738-3101-446e-ac5f-2326503a4c26\") " Jun 13 02:10:53.080173 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.080136 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57b1738-3101-446e-ac5f-2326503a4c26-kube-api-access-sbtxt" (OuterVolumeSpecName: "kube-api-access-sbtxt") pod "f57b1738-3101-446e-ac5f-2326503a4c26" (UID: "f57b1738-3101-446e-ac5f-2326503a4c26"). InnerVolumeSpecName "kube-api-access-sbtxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:10:53.179353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.179314 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbtxt\" (UniqueName: \"kubernetes.io/projected/f57b1738-3101-446e-ac5f-2326503a4c26-kube-api-access-sbtxt\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:10:53.678435 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.678395 2546 generic.go:356] "Generic (PLEG): container finished" podID="f57b1738-3101-446e-ac5f-2326503a4c26" containerID="e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637" exitCode=0 Jun 13 02:10:53.678629 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.678443 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:53.678629 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.678463 2546 scope.go:117] "RemoveContainer" containerID="e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637" Jun 13 02:10:53.680950 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:53.680917 2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" is forbidden: User \"system:node:ip-10-0-134-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-133.ec2.internal' and this object" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:53.687751 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.687721 2546 scope.go:117] "RemoveContainer" containerID="e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637" Jun 13 02:10:53.688072 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:53.688045 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637\": container with ID starting with e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637 not found: ID does not exist" containerID="e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637" Jun 13 02:10:53.688168 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.688083 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637"} err="failed to get container status \"e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637\": rpc error: code = NotFound desc = could not find container \"e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637\": container with ID starting with e845c9ee8c7a141b216fbe72b63c2bf599634dccc35a2353cde7a5738a8ad637 not found: ID does not exist" Jun 13 02:10:53.690461 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:53.690433 2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" is forbidden: User \"system:node:ip-10-0-134-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-133.ec2.internal' and this object" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:53.862963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.862910 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:53.957447 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:53.957343 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:54.057411 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:54.057367 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:54.158175 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:54.158136 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:54.394964 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:10:54.394879 2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xp4w8\" is forbidden: User \"system:node:ip-10-0-134-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-133.ec2.internal' and this object" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp4w8" Jun 13 02:10:54.397814 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:54.397769 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" path="/var/lib/kubelet/pods/f57b1738-3101-446e-ac5f-2326503a4c26/volumes" Jun 13 02:10:55.878164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:55.878125 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:55.944719 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:55.944672 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:56.472765 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:56.472722 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:10:56.573277 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:10:56.573228 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:00.281740 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:00.281706 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:00.334179 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:00.334139 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:06.904077 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:06.904041 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:07.003466 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:07.003422 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:09.324132 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:09.324095 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:09.424431 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:09.424400 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:09.754077 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:09.754043 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" event={"ID":"2ca25a7d-1f08-4d53-9380-96fd2f2f4239","Type":"ContainerStarted","Data":"49043e8e1f0f956c7f7e3b27062ee53ca113ed87893431ecd6ca199796911b2f"} Jun 13 02:11:09.770648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:09.770592 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs58m" podStartSLOduration=1.790033177 podStartE2EDuration="27.77057813s" totalImagesPullingTime="25.980544953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:09.769035917 +0000 UTC m=+635.716720836" watchObservedRunningTime="2026-06-13 02:11:09.77057813 +0000 UTC m=+635.718263050" Jun 13 02:11:27.079947 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.079911 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v"] Jun 13 02:11:27.080394 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.080202 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" containerName="manager" Jun 13 02:11:27.080394 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.080214 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" containerName="manager" Jun 13 02:11:27.080394 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.080269 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f57b1738-3101-446e-ac5f-2326503a4c26" containerName="manager" Jun 13 02:11:27.098712 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.098685 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v"] Jun 13 02:11:27.098897 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.098820 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.101313 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.101290 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2w4wn\"" Jun 13 02:11:27.112055 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.112025 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:27.155915 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.155877 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.155915 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.155912 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156129 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.155932 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156129 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.156008 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381f2494-d962-428e-ac70-7789ec70352e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156129 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.156078 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzfp6\" (UniqueName: \"kubernetes.io/projected/381f2494-d962-428e-ac70-7789ec70352e-kube-api-access-hzfp6\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156129 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.156116 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156272 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.156164 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156272 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.156189 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381f2494-d962-428e-ac70-7789ec70352e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.156272 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.156214 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381f2494-d962-428e-ac70-7789ec70352e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257540 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257505 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381f2494-d962-428e-ac70-7789ec70352e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257552 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzfp6\" (UniqueName: \"kubernetes.io/projected/381f2494-d962-428e-ac70-7789ec70352e-kube-api-access-hzfp6\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257599 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257626 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257655 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381f2494-d962-428e-ac70-7789ec70352e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257681 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381f2494-d962-428e-ac70-7789ec70352e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257944 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257713 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257944 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257739 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.257944 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.257768 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.258155 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.258131 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.258287 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.258182 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.258287 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.258215 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.258287 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.258276 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.258624 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.258604 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381f2494-d962-428e-ac70-7789ec70352e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.260227 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.260208 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381f2494-d962-428e-ac70-7789ec70352e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.260495 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.260473 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381f2494-d962-428e-ac70-7789ec70352e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.264943 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.264917 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381f2494-d962-428e-ac70-7789ec70352e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.265122 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.265106 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzfp6\" (UniqueName: \"kubernetes.io/projected/381f2494-d962-428e-ac70-7789ec70352e-kube-api-access-hzfp6\") pod \"maas-default-gateway-openshift-default-687ff6996-gll6v\" (UID: \"381f2494-d962-428e-ac70-7789ec70352e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.410907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.410835 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:27.494241 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.494211 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:27.569075 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.569038 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v"] Jun 13 02:11:27.571969 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:11:27.571941 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381f2494_d962_428e_ac70_7789ec70352e.slice/crio-04f0d739732141a2b0412d3f068e6132fcb1da9ff5b550020fe1cf83b5461825 WatchSource:0}: Error finding container 04f0d739732141a2b0412d3f068e6132fcb1da9ff5b550020fe1cf83b5461825: Status 404 returned error can't find the container with id 04f0d739732141a2b0412d3f068e6132fcb1da9ff5b550020fe1cf83b5461825 Jun 13 02:11:27.574175 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.574142 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:11:27.574259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.574205 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:11:27.574259 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.574235 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:11:27.824771 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.824735 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" event={"ID":"381f2494-d962-428e-ac70-7789ec70352e","Type":"ContainerStarted","Data":"2b37b6aebacdaee60b27a5402c85764184a933d4077ee91b48444f08a7a7e8ff"} Jun 13 02:11:27.824987 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.824812 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" event={"ID":"381f2494-d962-428e-ac70-7789ec70352e","Type":"ContainerStarted","Data":"04f0d739732141a2b0412d3f068e6132fcb1da9ff5b550020fe1cf83b5461825"} Jun 13 02:11:27.843854 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:27.843250 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" podStartSLOduration=0.843227572 podStartE2EDuration="843.227572ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:27.842131778 +0000 UTC m=+653.789816698" watchObservedRunningTime="2026-06-13 02:11:27.843227572 +0000 UTC m=+653.790912495" Jun 13 02:11:28.411364 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:28.411335 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:28.415676 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:28.415654 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:28.828935 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:28.828903 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:28.829936 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:28.829915 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:11:29.686527 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:29.686491 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:29.767020 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:29.766985 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:29.867698 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:29.867660 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:30.056030 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.055996 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:11:30.163391 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.163358 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:11:30.163391 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.163400 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:11:30.163601 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.163471 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.165754 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.165733 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 02:11:30.184418 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.184396 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgvl\" (UniqueName: \"kubernetes.io/projected/c6b35d57-7478-4b81-9025-ee4818e6024e-kube-api-access-5cgvl\") pod \"limitador-limitador-54d6d988d5-jxttc\" (UID: \"c6b35d57-7478-4b81-9025-ee4818e6024e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.184548 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.184446 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c6b35d57-7478-4b81-9025-ee4818e6024e-config-file\") pod \"limitador-limitador-54d6d988d5-jxttc\" (UID: \"c6b35d57-7478-4b81-9025-ee4818e6024e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.284874 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.284838 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgvl\" (UniqueName: \"kubernetes.io/projected/c6b35d57-7478-4b81-9025-ee4818e6024e-kube-api-access-5cgvl\") pod \"limitador-limitador-54d6d988d5-jxttc\" (UID: \"c6b35d57-7478-4b81-9025-ee4818e6024e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.285051 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.284915 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c6b35d57-7478-4b81-9025-ee4818e6024e-config-file\") pod \"limitador-limitador-54d6d988d5-jxttc\" (UID: \"c6b35d57-7478-4b81-9025-ee4818e6024e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.285516 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.285490 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c6b35d57-7478-4b81-9025-ee4818e6024e-config-file\") pod \"limitador-limitador-54d6d988d5-jxttc\" (UID: \"c6b35d57-7478-4b81-9025-ee4818e6024e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.292537 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.292518 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgvl\" (UniqueName: \"kubernetes.io/projected/c6b35d57-7478-4b81-9025-ee4818e6024e-kube-api-access-5cgvl\") pod \"limitador-limitador-54d6d988d5-jxttc\" (UID: \"c6b35d57-7478-4b81-9025-ee4818e6024e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.473087 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.473015 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:30.488163 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.488134 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:30.541397 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.541366 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:30.632690 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.632661 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:11:30.635009 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:11:30.634983 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b35d57_7478_4b81_9025_ee4818e6024e.slice/crio-da17b7707773bc70e6a9c8e8f1950fbb08d07dca6b3f0eba0202e2d8320531d5 WatchSource:0}: Error finding container da17b7707773bc70e6a9c8e8f1950fbb08d07dca6b3f0eba0202e2d8320531d5: Status 404 returned error can't find the container with id da17b7707773bc70e6a9c8e8f1950fbb08d07dca6b3f0eba0202e2d8320531d5 Jun 13 02:11:30.649739 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.649708 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zc7s9"] Jun 13 02:11:30.681373 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.681337 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:11:30.681373 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.681345 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zc7s9"] Jun 13 02:11:30.683462 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.683443 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mftfz\"" Jun 13 02:11:30.788363 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.788334 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vmjh\" (UniqueName: \"kubernetes.io/projected/4af83506-76da-487d-a7ce-7195f7311923-kube-api-access-6vmjh\") pod \"authorino-75d556bd77-zc7s9\" (UID: \"4af83506-76da-487d-a7ce-7195f7311923\") " pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:11:30.837978 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.837944 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" event={"ID":"c6b35d57-7478-4b81-9025-ee4818e6024e","Type":"ContainerStarted","Data":"da17b7707773bc70e6a9c8e8f1950fbb08d07dca6b3f0eba0202e2d8320531d5"} Jun 13 02:11:30.889648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.889616 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vmjh\" (UniqueName: \"kubernetes.io/projected/4af83506-76da-487d-a7ce-7195f7311923-kube-api-access-6vmjh\") pod \"authorino-75d556bd77-zc7s9\" (UID: \"4af83506-76da-487d-a7ce-7195f7311923\") " pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:11:30.900326 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.900299 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vmjh\" (UniqueName: \"kubernetes.io/projected/4af83506-76da-487d-a7ce-7195f7311923-kube-api-access-6vmjh\") pod \"authorino-75d556bd77-zc7s9\" (UID: \"4af83506-76da-487d-a7ce-7195f7311923\") " pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:11:30.990390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:30.990358 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:11:31.160896 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:31.160770 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zc7s9"] Jun 13 02:11:31.164640 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:11:31.164561 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4af83506_76da_487d_a7ce_7195f7311923.slice/crio-e53e5afae3c6e187f3db1e8b87ef7ca2204bd3017857307e533d3cd672553d0b WatchSource:0}: Error finding container e53e5afae3c6e187f3db1e8b87ef7ca2204bd3017857307e533d3cd672553d0b: Status 404 returned error can't find the container with id e53e5afae3c6e187f3db1e8b87ef7ca2204bd3017857307e533d3cd672553d0b Jun 13 02:11:31.844947 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:31.844892 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zc7s9" event={"ID":"4af83506-76da-487d-a7ce-7195f7311923","Type":"ContainerStarted","Data":"e53e5afae3c6e187f3db1e8b87ef7ca2204bd3017857307e533d3cd672553d0b"} Jun 13 02:11:36.869581 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:36.869539 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zc7s9" event={"ID":"4af83506-76da-487d-a7ce-7195f7311923","Type":"ContainerStarted","Data":"725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147"} Jun 13 02:11:36.870969 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:36.870940 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" event={"ID":"c6b35d57-7478-4b81-9025-ee4818e6024e","Type":"ContainerStarted","Data":"f4960bea5855d3c770bb187e19f812ab3862c97e151e65bc670ebc7ca99d749c"} Jun 13 02:11:36.871097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:36.871067 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:36.885716 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:36.885673 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zc7s9" podStartSLOduration=2.218172502 podStartE2EDuration="6.885659373s" totalImagesPullingTime="4.667486871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:36.884262295 +0000 UTC m=+662.831947214" watchObservedRunningTime="2026-06-13 02:11:36.885659373 +0000 UTC m=+662.833344293" Jun 13 02:11:36.904320 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:36.904264 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" podStartSLOduration=1.709803008 podStartE2EDuration="6.904243938s" totalImagesPullingTime="5.19444093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:36.901754653 +0000 UTC m=+662.849439595" watchObservedRunningTime="2026-06-13 02:11:36.904243938 +0000 UTC m=+662.851928859" Jun 13 02:11:39.963542 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:39.963507 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:40.014059 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:40.014031 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:11:47.875318 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:47.875284 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jxttc" Jun 13 02:11:50.337807 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:11:50.337758 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:00.418011 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:00.417976 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:00.517195 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:00.517161 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:00.657224 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:00.657195 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:25.431727 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:25.431632 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:25.530691 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:25.530659 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:57.925361 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:57.925323 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:58.155615 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.155577 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6qrnh"] Jun 13 02:12:58.158734 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.158717 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:12:58.168997 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.168975 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6qrnh"] Jun 13 02:12:58.182117 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.182057 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:12:58.316026 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.315982 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fssgk\" (UniqueName: \"kubernetes.io/projected/b798554d-d877-42d0-b6c0-f334024bc934-kube-api-access-fssgk\") pod \"authorino-5d4b67c446-6qrnh\" (UID: \"b798554d-d877-42d0-b6c0-f334024bc934\") " pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:12:58.384122 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.384092 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6qrnh"] Jun 13 02:12:58.384343 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:12:58.384324 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fssgk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-6qrnh" podUID="b798554d-d877-42d0-b6c0-f334024bc934" Jun 13 02:12:58.403498 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.403468 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f87665cb9-rjb24"] Jun 13 02:12:58.409533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.408152 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:12:58.412089 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.412065 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f87665cb9-rjb24"] Jun 13 02:12:58.416459 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.416434 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fssgk\" (UniqueName: \"kubernetes.io/projected/b798554d-d877-42d0-b6c0-f334024bc934-kube-api-access-fssgk\") pod \"authorino-5d4b67c446-6qrnh\" (UID: \"b798554d-d877-42d0-b6c0-f334024bc934\") " pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:12:58.423931 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.423913 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fssgk\" (UniqueName: \"kubernetes.io/projected/b798554d-d877-42d0-b6c0-f334024bc934-kube-api-access-fssgk\") pod \"authorino-5d4b67c446-6qrnh\" (UID: \"b798554d-d877-42d0-b6c0-f334024bc934\") " pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:12:58.500385 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.500348 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f87665cb9-rjb24"] Jun 13 02:12:58.500628 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:12:58.500608 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nbpgn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7f87665cb9-rjb24" podUID="a432beb5-f982-4870-bcb2-80588e085903" Jun 13 02:12:58.517095 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.517056 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbpgn\" (UniqueName: \"kubernetes.io/projected/a432beb5-f982-4870-bcb2-80588e085903-kube-api-access-nbpgn\") pod \"authorino-7f87665cb9-rjb24\" (UID: \"a432beb5-f982-4870-bcb2-80588e085903\") " pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:12:58.527627 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.527600 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67df7744f-tb22b"] Jun 13 02:12:58.530748 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.530734 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.533010 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.532990 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 13 02:12:58.537038 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.537014 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67df7744f-tb22b"] Jun 13 02:12:58.617450 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.617415 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmqh\" (UniqueName: \"kubernetes.io/projected/9fde58c0-d1ba-409c-a8c6-b7615c422b40-kube-api-access-xvmqh\") pod \"authorino-67df7744f-tb22b\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.617634 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.617483 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fde58c0-d1ba-409c-a8c6-b7615c422b40-tls-cert\") pod \"authorino-67df7744f-tb22b\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.617634 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.617538 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbpgn\" (UniqueName: \"kubernetes.io/projected/a432beb5-f982-4870-bcb2-80588e085903-kube-api-access-nbpgn\") pod \"authorino-7f87665cb9-rjb24\" (UID: \"a432beb5-f982-4870-bcb2-80588e085903\") " pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:12:58.625495 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.625469 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbpgn\" (UniqueName: \"kubernetes.io/projected/a432beb5-f982-4870-bcb2-80588e085903-kube-api-access-nbpgn\") pod \"authorino-7f87665cb9-rjb24\" (UID: \"a432beb5-f982-4870-bcb2-80588e085903\") " pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:12:58.718197 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.718166 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fde58c0-d1ba-409c-a8c6-b7615c422b40-tls-cert\") pod \"authorino-67df7744f-tb22b\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.718359 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.718267 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmqh\" (UniqueName: \"kubernetes.io/projected/9fde58c0-d1ba-409c-a8c6-b7615c422b40-kube-api-access-xvmqh\") pod \"authorino-67df7744f-tb22b\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.720533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.720514 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fde58c0-d1ba-409c-a8c6-b7615c422b40-tls-cert\") pod \"authorino-67df7744f-tb22b\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.725004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.724987 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmqh\" (UniqueName: \"kubernetes.io/projected/9fde58c0-d1ba-409c-a8c6-b7615c422b40-kube-api-access-xvmqh\") pod \"authorino-67df7744f-tb22b\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.840598 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.840512 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:12:58.961985 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.961959 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67df7744f-tb22b"] Jun 13 02:12:58.964156 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:12:58.964128 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fde58c0_d1ba_409c_a8c6_b7615c422b40.slice/crio-7674818256f27511284ecc04b76eedcf2558581fdc34146e55a53ad10978733a WatchSource:0}: Error finding container 7674818256f27511284ecc04b76eedcf2558581fdc34146e55a53ad10978733a: Status 404 returned error can't find the container with id 7674818256f27511284ecc04b76eedcf2558581fdc34146e55a53ad10978733a Jun 13 02:12:58.965528 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:58.965510 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:12:59.205672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.205584 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67df7744f-tb22b" event={"ID":"9fde58c0-d1ba-409c-a8c6-b7615c422b40","Type":"ContainerStarted","Data":"7674818256f27511284ecc04b76eedcf2558581fdc34146e55a53ad10978733a"} Jun 13 02:12:59.205672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.205619 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:12:59.205672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.205596 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:12:59.213649 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.213628 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:12:59.215714 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.215700 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:12:59.324578 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.324550 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fssgk\" (UniqueName: \"kubernetes.io/projected/b798554d-d877-42d0-b6c0-f334024bc934-kube-api-access-fssgk\") pod \"b798554d-d877-42d0-b6c0-f334024bc934\" (UID: \"b798554d-d877-42d0-b6c0-f334024bc934\") " Jun 13 02:12:59.324734 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.324588 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbpgn\" (UniqueName: \"kubernetes.io/projected/a432beb5-f982-4870-bcb2-80588e085903-kube-api-access-nbpgn\") pod \"a432beb5-f982-4870-bcb2-80588e085903\" (UID: \"a432beb5-f982-4870-bcb2-80588e085903\") " Jun 13 02:12:59.326774 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.326742 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a432beb5-f982-4870-bcb2-80588e085903-kube-api-access-nbpgn" (OuterVolumeSpecName: "kube-api-access-nbpgn") pod "a432beb5-f982-4870-bcb2-80588e085903" (UID: "a432beb5-f982-4870-bcb2-80588e085903"). InnerVolumeSpecName "kube-api-access-nbpgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:12:59.326774 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.326755 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b798554d-d877-42d0-b6c0-f334024bc934-kube-api-access-fssgk" (OuterVolumeSpecName: "kube-api-access-fssgk") pod "b798554d-d877-42d0-b6c0-f334024bc934" (UID: "b798554d-d877-42d0-b6c0-f334024bc934"). InnerVolumeSpecName "kube-api-access-fssgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:12:59.425583 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.425562 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fssgk\" (UniqueName: \"kubernetes.io/projected/b798554d-d877-42d0-b6c0-f334024bc934-kube-api-access-fssgk\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:12:59.425670 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:12:59.425584 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbpgn\" (UniqueName: \"kubernetes.io/projected/a432beb5-f982-4870-bcb2-80588e085903-kube-api-access-nbpgn\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:13:00.216526 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.216473 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f87665cb9-rjb24" Jun 13 02:13:00.216526 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.216497 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67df7744f-tb22b" event={"ID":"9fde58c0-d1ba-409c-a8c6-b7615c422b40","Type":"ContainerStarted","Data":"c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5"} Jun 13 02:13:00.216991 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.216679 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6qrnh" Jun 13 02:13:00.233701 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.233663 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67df7744f-tb22b" podStartSLOduration=1.850168856 podStartE2EDuration="2.233650451s" totalImagesPullingTime="383.481595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:00.232897398 +0000 UTC m=+746.180582318" watchObservedRunningTime="2026-06-13 02:13:00.233650451 +0000 UTC m=+746.181335371" Jun 13 02:13:00.251442 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.251391 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f87665cb9-rjb24"] Jun 13 02:13:00.254278 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.254254 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f87665cb9-rjb24"] Jun 13 02:13:00.256174 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.256152 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zc7s9"] Jun 13 02:13:00.256519 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.256344 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zc7s9" podUID="4af83506-76da-487d-a7ce-7195f7311923" containerName="authorino" containerID="cri-o://725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147" gracePeriod=30 Jun 13 02:13:00.271357 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.271329 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6qrnh"] Jun 13 02:13:00.274333 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.274312 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6qrnh"] Jun 13 02:13:00.396394 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.396357 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a432beb5-f982-4870-bcb2-80588e085903" path="/var/lib/kubelet/pods/a432beb5-f982-4870-bcb2-80588e085903/volumes" Jun 13 02:13:00.396592 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.396578 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b798554d-d877-42d0-b6c0-f334024bc934" path="/var/lib/kubelet/pods/b798554d-d877-42d0-b6c0-f334024bc934/volumes" Jun 13 02:13:00.495563 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.495540 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:13:00.635713 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.635682 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vmjh\" (UniqueName: \"kubernetes.io/projected/4af83506-76da-487d-a7ce-7195f7311923-kube-api-access-6vmjh\") pod \"4af83506-76da-487d-a7ce-7195f7311923\" (UID: \"4af83506-76da-487d-a7ce-7195f7311923\") " Jun 13 02:13:00.639127 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.639090 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af83506-76da-487d-a7ce-7195f7311923-kube-api-access-6vmjh" (OuterVolumeSpecName: "kube-api-access-6vmjh") pod "4af83506-76da-487d-a7ce-7195f7311923" (UID: "4af83506-76da-487d-a7ce-7195f7311923"). InnerVolumeSpecName "kube-api-access-6vmjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:13:00.737190 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:00.737153 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vmjh\" (UniqueName: \"kubernetes.io/projected/4af83506-76da-487d-a7ce-7195f7311923-kube-api-access-6vmjh\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:13:01.222422 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.222330 2546 generic.go:356] "Generic (PLEG): container finished" podID="4af83506-76da-487d-a7ce-7195f7311923" containerID="725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147" exitCode=0 Jun 13 02:13:01.222422 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.222387 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zc7s9" Jun 13 02:13:01.222903 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.222416 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zc7s9" event={"ID":"4af83506-76da-487d-a7ce-7195f7311923","Type":"ContainerDied","Data":"725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147"} Jun 13 02:13:01.222903 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.222469 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zc7s9" event={"ID":"4af83506-76da-487d-a7ce-7195f7311923","Type":"ContainerDied","Data":"e53e5afae3c6e187f3db1e8b87ef7ca2204bd3017857307e533d3cd672553d0b"} Jun 13 02:13:01.222903 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.222493 2546 scope.go:117] "RemoveContainer" containerID="725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147" Jun 13 02:13:01.230510 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.230491 2546 scope.go:117] "RemoveContainer" containerID="725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147" Jun 13 02:13:01.230819 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:13:01.230771 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147\": container with ID starting with 725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147 not found: ID does not exist" containerID="725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147" Jun 13 02:13:01.230881 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.230829 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147"} err="failed to get container status \"725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147\": rpc error: code = NotFound desc = could not find container \"725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147\": container with ID starting with 725aed988ec2bfffb2ff44e601696b48b44bb5cc005c50553eba0c2180423147 not found: ID does not exist" Jun 13 02:13:01.241022 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.240993 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zc7s9"] Jun 13 02:13:01.243693 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:01.243672 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zc7s9"] Jun 13 02:13:02.395512 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:02.395477 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af83506-76da-487d-a7ce-7195f7311923" path="/var/lib/kubelet/pods/4af83506-76da-487d-a7ce-7195f7311923/volumes" Jun 13 02:13:03.654264 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:03.654206 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:03.754373 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:03.754310 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:03.826338 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:03.826301 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:04.121176 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:04.121144 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:07.688166 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:07.688109 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:07.832391 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:07.832360 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:38.654742 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:38.654688 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:38.952074 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:38.951966 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:39.115588 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:39.115540 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:39.189647 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:39.189615 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:39.238378 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:39.238352 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:13:44.995152 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:44.995088 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:47.411440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:47.411407 2546 generic.go:356] "Generic (PLEG): container finished" podID="381f2494-d962-428e-ac70-7789ec70352e" containerID="2b37b6aebacdaee60b27a5402c85764184a933d4077ee91b48444f08a7a7e8ff" exitCode=0 Jun 13 02:13:47.411907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:47.411467 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" event={"ID":"381f2494-d962-428e-ac70-7789ec70352e","Type":"ContainerDied","Data":"2b37b6aebacdaee60b27a5402c85764184a933d4077ee91b48444f08a7a7e8ff"} Jun 13 02:13:47.411907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:47.411824 2546 scope.go:117] "RemoveContainer" containerID="2b37b6aebacdaee60b27a5402c85764184a933d4077ee91b48444f08a7a7e8ff" Jun 13 02:13:47.412733 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:47.412700 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:13:47.412873 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:47.412806 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:13:47.412873 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:47.412858 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:13:48.416765 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:48.416678 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" event={"ID":"381f2494-d962-428e-ac70-7789ec70352e","Type":"ContainerStarted","Data":"713ebf8edd5a5fe8448ac1bcd27121cfde66d9539c20c016d7e2cffc968fab44"} Jun 13 02:13:49.411990 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:49.411934 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:13:49.412176 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:49.412134 2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-gll6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 13 02:13:49.412221 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:49.412182 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" podUID="381f2494-d962-428e-ac70-7789ec70352e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 13 02:13:50.140990 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:50.140951 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:13:50.411754 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:50.411666 2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-gll6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 13 02:13:50.411754 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:50.411718 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" podUID="381f2494-d962-428e-ac70-7789ec70352e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 13 02:13:51.411452 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:51.411412 2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-gll6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 13 02:13:51.411882 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:51.411485 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" podUID="381f2494-d962-428e-ac70-7789ec70352e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 13 02:13:52.412135 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:52.412097 2546 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-gll6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 13 02:13:52.412544 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:52.412166 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" podUID="381f2494-d962-428e-ac70-7789ec70352e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 13 02:13:53.414636 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:53.414604 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:13:53.415127 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:53.415057 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:13:53.415622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:13:53.415602 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-gll6v" Jun 13 02:14:19.753353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:19.753317 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:14:28.203470 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.203433 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c948cc67c-5xn6w"] Jun 13 02:14:28.203863 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.203707 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af83506-76da-487d-a7ce-7195f7311923" containerName="authorino" Jun 13 02:14:28.203863 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.203717 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af83506-76da-487d-a7ce-7195f7311923" containerName="authorino" Jun 13 02:14:28.203863 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.203792 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af83506-76da-487d-a7ce-7195f7311923" containerName="authorino" Jun 13 02:14:28.206556 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.206541 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.208723 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.208704 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 13 02:14:28.214682 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.214658 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c948cc67c-5xn6w"] Jun 13 02:14:28.243014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.242985 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b61b5e49-cbd8-4e90-a329-44787ed086f6-oidc-ca\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.243131 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.243050 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61b5e49-cbd8-4e90-a329-44787ed086f6-tls-cert\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.243131 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.243081 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxn7n\" (UniqueName: \"kubernetes.io/projected/b61b5e49-cbd8-4e90-a329-44787ed086f6-kube-api-access-jxn7n\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.344050 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.344012 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxn7n\" (UniqueName: \"kubernetes.io/projected/b61b5e49-cbd8-4e90-a329-44787ed086f6-kube-api-access-jxn7n\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.344207 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.344068 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b61b5e49-cbd8-4e90-a329-44787ed086f6-oidc-ca\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.344207 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.344122 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61b5e49-cbd8-4e90-a329-44787ed086f6-tls-cert\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.344761 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.344735 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b61b5e49-cbd8-4e90-a329-44787ed086f6-oidc-ca\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.346440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.346420 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61b5e49-cbd8-4e90-a329-44787ed086f6-tls-cert\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.353994 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.353969 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxn7n\" (UniqueName: \"kubernetes.io/projected/b61b5e49-cbd8-4e90-a329-44787ed086f6-kube-api-access-jxn7n\") pod \"authorino-7c948cc67c-5xn6w\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.515904 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.515875 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:14:28.638441 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:28.638415 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c948cc67c-5xn6w"] Jun 13 02:14:28.640725 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:14:28.640697 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb61b5e49_cbd8_4e90_a329_44787ed086f6.slice/crio-391168a1b1031b1a88da6d8d54cdb9158b1ae8a9528bf37cebe7bd27db7162e5 WatchSource:0}: Error finding container 391168a1b1031b1a88da6d8d54cdb9158b1ae8a9528bf37cebe7bd27db7162e5: Status 404 returned error can't find the container with id 391168a1b1031b1a88da6d8d54cdb9158b1ae8a9528bf37cebe7bd27db7162e5 Jun 13 02:14:29.588702 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.588605 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" event={"ID":"b61b5e49-cbd8-4e90-a329-44787ed086f6","Type":"ContainerStarted","Data":"3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed"} Jun 13 02:14:29.588702 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.588656 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" event={"ID":"b61b5e49-cbd8-4e90-a329-44787ed086f6","Type":"ContainerStarted","Data":"391168a1b1031b1a88da6d8d54cdb9158b1ae8a9528bf37cebe7bd27db7162e5"} Jun 13 02:14:29.603201 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.603150 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" podStartSLOduration=1.005492837 podStartE2EDuration="1.60313232s" totalImagesPullingTime="597.639483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:14:29.602235562 +0000 UTC m=+835.549920482" watchObservedRunningTime="2026-06-13 02:14:29.60313232 +0000 UTC m=+835.550817241" Jun 13 02:14:29.627775 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.627744 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67df7744f-tb22b"] Jun 13 02:14:29.627949 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.627928 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67df7744f-tb22b" podUID="9fde58c0-d1ba-409c-a8c6-b7615c422b40" containerName="authorino" containerID="cri-o://c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5" gracePeriod=30 Jun 13 02:14:29.880203 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.880175 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:14:29.956880 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.956851 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvmqh\" (UniqueName: \"kubernetes.io/projected/9fde58c0-d1ba-409c-a8c6-b7615c422b40-kube-api-access-xvmqh\") pod \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " Jun 13 02:14:29.957069 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.956909 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fde58c0-d1ba-409c-a8c6-b7615c422b40-tls-cert\") pod \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\" (UID: \"9fde58c0-d1ba-409c-a8c6-b7615c422b40\") " Jun 13 02:14:29.958895 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.958864 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fde58c0-d1ba-409c-a8c6-b7615c422b40-kube-api-access-xvmqh" (OuterVolumeSpecName: "kube-api-access-xvmqh") pod "9fde58c0-d1ba-409c-a8c6-b7615c422b40" (UID: "9fde58c0-d1ba-409c-a8c6-b7615c422b40"). InnerVolumeSpecName "kube-api-access-xvmqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:14:29.966147 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:29.966124 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fde58c0-d1ba-409c-a8c6-b7615c422b40-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9fde58c0-d1ba-409c-a8c6-b7615c422b40" (UID: "9fde58c0-d1ba-409c-a8c6-b7615c422b40"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:14:30.058427 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.058391 2546 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fde58c0-d1ba-409c-a8c6-b7615c422b40-tls-cert\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:14:30.058427 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.058421 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvmqh\" (UniqueName: \"kubernetes.io/projected/9fde58c0-d1ba-409c-a8c6-b7615c422b40-kube-api-access-xvmqh\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:14:30.270160 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.270125 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:14:30.372912 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.372878 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:14:30.594398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.594318 2546 generic.go:356] "Generic (PLEG): container finished" podID="9fde58c0-d1ba-409c-a8c6-b7615c422b40" containerID="c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5" exitCode=0 Jun 13 02:14:30.594398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.594366 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67df7744f-tb22b" Jun 13 02:14:30.594861 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.594397 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67df7744f-tb22b" event={"ID":"9fde58c0-d1ba-409c-a8c6-b7615c422b40","Type":"ContainerDied","Data":"c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5"} Jun 13 02:14:30.594861 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.594440 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67df7744f-tb22b" event={"ID":"9fde58c0-d1ba-409c-a8c6-b7615c422b40","Type":"ContainerDied","Data":"7674818256f27511284ecc04b76eedcf2558581fdc34146e55a53ad10978733a"} Jun 13 02:14:30.594861 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.594458 2546 scope.go:117] "RemoveContainer" containerID="c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5" Jun 13 02:14:30.602326 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.602308 2546 scope.go:117] "RemoveContainer" containerID="c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5" Jun 13 02:14:30.602562 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:14:30.602547 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5\": container with ID starting with c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5 not found: ID does not exist" containerID="c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5" Jun 13 02:14:30.602599 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.602569 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5"} err="failed to get container status \"c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5\": rpc error: code = NotFound desc = could not find container \"c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5\": container with ID starting with c106039d5e30b8894793220adba7de0cf359f0ea00980f5dd6fac54947ca06c5 not found: ID does not exist" Jun 13 02:14:30.609296 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.609277 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67df7744f-tb22b"] Jun 13 02:14:30.610957 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:30.610937 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67df7744f-tb22b"] Jun 13 02:14:32.395764 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:32.395731 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fde58c0-d1ba-409c-a8c6-b7615c422b40" path="/var/lib/kubelet/pods/9fde58c0-d1ba-409c-a8c6-b7615c422b40/volumes" Jun 13 02:14:36.872679 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:36.872645 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:14:47.137148 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:47.137117 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:14:47.492178 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:47.492140 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:14:59.045839 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.045802 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl"] Jun 13 02:14:59.046215 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.046093 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fde58c0-d1ba-409c-a8c6-b7615c422b40" containerName="authorino" Jun 13 02:14:59.046215 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.046103 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fde58c0-d1ba-409c-a8c6-b7615c422b40" containerName="authorino" Jun 13 02:14:59.046215 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.046164 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fde58c0-d1ba-409c-a8c6-b7615c422b40" containerName="authorino" Jun 13 02:14:59.049142 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.049125 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.052814 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.052792 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vzrsj\"" Jun 13 02:14:59.052947 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.052855 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 13 02:14:59.052947 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.052904 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 02:14:59.052947 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.052932 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 02:14:59.059104 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.059083 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl"] Jun 13 02:14:59.066680 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.066643 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:14:59.197297 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.197266 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.197478 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.197302 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.197478 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.197324 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d883e185-2a29-489d-b4fb-4e6b4954a2ec-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.197478 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.197412 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.197478 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.197456 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvm9\" (UniqueName: \"kubernetes.io/projected/d883e185-2a29-489d-b4fb-4e6b4954a2ec-kube-api-access-lqvm9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.197636 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.197479 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298457 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298374 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298457 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298420 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvm9\" (UniqueName: \"kubernetes.io/projected/d883e185-2a29-489d-b4fb-4e6b4954a2ec-kube-api-access-lqvm9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298457 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298444 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298725 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298487 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298725 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298507 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298725 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298528 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d883e185-2a29-489d-b4fb-4e6b4954a2ec-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298893 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.298981 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298960 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.299023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.298988 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.300731 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.300707 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d883e185-2a29-489d-b4fb-4e6b4954a2ec-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.300933 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.300916 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d883e185-2a29-489d-b4fb-4e6b4954a2ec-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.305715 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.305693 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvm9\" (UniqueName: \"kubernetes.io/projected/d883e185-2a29-489d-b4fb-4e6b4954a2ec-kube-api-access-lqvm9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pllnl\" (UID: \"d883e185-2a29-489d-b4fb-4e6b4954a2ec\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.359564 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.359538 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:14:59.487722 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.487697 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl"] Jun 13 02:14:59.489813 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:14:59.489774 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd883e185_2a29_489d_b4fb_4e6b4954a2ec.slice/crio-087e26bc7e7583f800f4e32d8e0bcc297afa5857f8f86469c22aedd3c9b1274e WatchSource:0}: Error finding container 087e26bc7e7583f800f4e32d8e0bcc297afa5857f8f86469c22aedd3c9b1274e: Status 404 returned error can't find the container with id 087e26bc7e7583f800f4e32d8e0bcc297afa5857f8f86469c22aedd3c9b1274e Jun 13 02:14:59.588063 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.587969 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:14:59.731524 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:14:59.731468 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" event={"ID":"d883e185-2a29-489d-b4fb-4e6b4954a2ec","Type":"ContainerStarted","Data":"087e26bc7e7583f800f4e32d8e0bcc297afa5857f8f86469c22aedd3c9b1274e"} Jun 13 02:15:03.753136 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:03.753101 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" event={"ID":"d883e185-2a29-489d-b4fb-4e6b4954a2ec","Type":"ContainerStarted","Data":"eaf747f3901c939b9ee66c6feb9bd7c78d564be05035ca14f069289c573c1ecd"} Jun 13 02:15:04.759003 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:04.758970 2546 generic.go:356] "Generic (PLEG): container finished" podID="d883e185-2a29-489d-b4fb-4e6b4954a2ec" containerID="eaf747f3901c939b9ee66c6feb9bd7c78d564be05035ca14f069289c573c1ecd" exitCode=0 Jun 13 02:15:04.759381 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:04.759032 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" event={"ID":"d883e185-2a29-489d-b4fb-4e6b4954a2ec","Type":"ContainerDied","Data":"eaf747f3901c939b9ee66c6feb9bd7c78d564be05035ca14f069289c573c1ecd"} Jun 13 02:15:05.366643 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:05.366605 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:15:05.999122 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:05.999087 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:15:06.771415 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:06.771378 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" event={"ID":"d883e185-2a29-489d-b4fb-4e6b4954a2ec","Type":"ContainerStarted","Data":"695db6aa7b6fdf007493bc6f47ba72cee02bcf8859490ba3b350a0915406f973"} Jun 13 02:15:06.790293 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:06.790248 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" podStartSLOduration=1.562356121 podStartE2EDuration="7.790234389s" totalImagesPullingTime="4.961254206s" totalInitContainerRuntime="1.266624062s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:14:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:15:06.789396785 +0000 UTC m=+872.737081703" watchObservedRunningTime="2026-06-13 02:15:06.790234389 +0000 UTC m=+872.737919309" Jun 13 02:15:08.657958 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:08.657923 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:15:09.360419 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:09.360373 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:15:09.360609 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:09.360442 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:15:09.372938 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:09.372909 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:15:09.583794 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:09.583742 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:15:09.802601 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:09.802568 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pllnl" Jun 13 02:15:17.626125 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.626091 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn"] Jun 13 02:15:17.648672 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.648645 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn"] Jun 13 02:15:17.648843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.648738 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.648983 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.648958 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:15:17.651188 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.651159 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 13 02:15:17.761638 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.761591 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.761843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.761641 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.761843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.761699 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96985\" (UniqueName: \"kubernetes.io/projected/cacfd20b-08cb-47e7-9f22-65f8763bbabb-kube-api-access-96985\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.761843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.761744 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.761968 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.761853 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cacfd20b-08cb-47e7-9f22-65f8763bbabb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.761968 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.761893 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862411 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862372 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862431 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cacfd20b-08cb-47e7-9f22-65f8763bbabb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862461 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862500 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862519 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862608 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862536 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96985\" (UniqueName: \"kubernetes.io/projected/cacfd20b-08cb-47e7-9f22-65f8763bbabb-kube-api-access-96985\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.862956 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862925 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.863026 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.862956 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.863026 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.863016 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.864769 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.864744 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cacfd20b-08cb-47e7-9f22-65f8763bbabb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.864930 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.864912 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cacfd20b-08cb-47e7-9f22-65f8763bbabb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.872707 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.872685 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96985\" (UniqueName: \"kubernetes.io/projected/cacfd20b-08cb-47e7-9f22-65f8763bbabb-kube-api-access-96985\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn\" (UID: \"cacfd20b-08cb-47e7-9f22-65f8763bbabb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:17.959591 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:17.959502 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:15:18.087702 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:18.087677 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn"] Jun 13 02:15:18.591023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:18.590988 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:15:18.826692 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:18.826654 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" event={"ID":"cacfd20b-08cb-47e7-9f22-65f8763bbabb","Type":"ContainerStarted","Data":"eb84ca1a1efa859f03d74740b437ee56ea86cacc9e835f42773d08cb404a87d4"} Jun 13 02:15:18.827101 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:18.826722 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" event={"ID":"cacfd20b-08cb-47e7-9f22-65f8763bbabb","Type":"ContainerStarted","Data":"8daf2657bce91f8f1892c437224ce46c4c8e4eb1d9277e88ed5c986275c0dce8"} Jun 13 02:15:30.133225 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.133193 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz"] Jun 13 02:15:30.136969 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.136947 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.139331 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.139310 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 13 02:15:30.148536 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.148513 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz"] Jun 13 02:15:30.160351 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.160325 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.160456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.160360 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d1da4b-4aaa-4181-a5f1-61e565c9df78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.160456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.160389 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.160456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.160430 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.160456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.160449 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.160594 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.160474 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4d5\" (UniqueName: \"kubernetes.io/projected/10d1da4b-4aaa-4181-a5f1-61e565c9df78-kube-api-access-nw4d5\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.169925 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.169906 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:15:30.260898 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.260861 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.260911 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4d5\" (UniqueName: \"kubernetes.io/projected/10d1da4b-4aaa-4181-a5f1-61e565c9df78-kube-api-access-nw4d5\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.260961 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.260987 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d1da4b-4aaa-4181-a5f1-61e565c9df78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.261029 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261062 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.261051 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261321 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.261281 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261379 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.261317 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.261440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.261391 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.263366 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.263333 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d1da4b-4aaa-4181-a5f1-61e565c9df78-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.263627 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.263607 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d1da4b-4aaa-4181-a5f1-61e565c9df78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.270440 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.270420 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4d5\" (UniqueName: \"kubernetes.io/projected/10d1da4b-4aaa-4181-a5f1-61e565c9df78-kube-api-access-nw4d5\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c92xz\" (UID: \"10d1da4b-4aaa-4181-a5f1-61e565c9df78\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.449364 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.449277 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:15:30.578767 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.578730 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz"] Jun 13 02:15:30.582296 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:15:30.582268 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d1da4b_4aaa_4181_a5f1_61e565c9df78.slice/crio-986751402bf939d92f048ab5deb07312156f8c13ab00239fefc179ff3f825766 WatchSource:0}: Error finding container 986751402bf939d92f048ab5deb07312156f8c13ab00239fefc179ff3f825766: Status 404 returned error can't find the container with id 986751402bf939d92f048ab5deb07312156f8c13ab00239fefc179ff3f825766 Jun 13 02:15:30.882209 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.882168 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" event={"ID":"10d1da4b-4aaa-4181-a5f1-61e565c9df78","Type":"ContainerStarted","Data":"31b43f5f269beeff722ef7524f6abd70ba0473c7e3a3ff20a905a576b6e31d6c"} Jun 13 02:15:30.882209 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:30.882208 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" event={"ID":"10d1da4b-4aaa-4181-a5f1-61e565c9df78","Type":"ContainerStarted","Data":"986751402bf939d92f048ab5deb07312156f8c13ab00239fefc179ff3f825766"} Jun 13 02:15:31.181622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:31.181543 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:15:31.291390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:15:31.291341 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:16:11.054622 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:11.054586 2546 generic.go:356] "Generic (PLEG): container finished" podID="cacfd20b-08cb-47e7-9f22-65f8763bbabb" containerID="eb84ca1a1efa859f03d74740b437ee56ea86cacc9e835f42773d08cb404a87d4" exitCode=0 Jun 13 02:16:11.055044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:11.054663 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" event={"ID":"cacfd20b-08cb-47e7-9f22-65f8763bbabb","Type":"ContainerDied","Data":"eb84ca1a1efa859f03d74740b437ee56ea86cacc9e835f42773d08cb404a87d4"} Jun 13 02:16:12.061459 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:12.061427 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" event={"ID":"cacfd20b-08cb-47e7-9f22-65f8763bbabb","Type":"ContainerStarted","Data":"4b7d9ff984dd850be75adeccd5ca72732e8bba73e0164c76cfb670a0cbb910f5"} Jun 13 02:16:12.080204 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:12.080157 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" podStartSLOduration=2.363621571 podStartE2EDuration="55.08014172s" totalImagesPullingTime="167.893042ms" totalInitContainerRuntime="52.548627107s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:16:12.079064269 +0000 UTC m=+938.026749190" watchObservedRunningTime="2026-06-13 02:16:12.08014172 +0000 UTC m=+938.027826640" Jun 13 02:16:17.960372 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:17.960330 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:16:17.960844 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:17.960412 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:16:17.973196 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:17.973173 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:16:18.098280 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:18.098250 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn" Jun 13 02:16:26.120878 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:26.120843 2546 generic.go:356] "Generic (PLEG): container finished" podID="10d1da4b-4aaa-4181-a5f1-61e565c9df78" containerID="31b43f5f269beeff722ef7524f6abd70ba0473c7e3a3ff20a905a576b6e31d6c" exitCode=0 Jun 13 02:16:26.121351 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:26.120895 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" event={"ID":"10d1da4b-4aaa-4181-a5f1-61e565c9df78","Type":"ContainerDied","Data":"31b43f5f269beeff722ef7524f6abd70ba0473c7e3a3ff20a905a576b6e31d6c"} Jun 13 02:16:27.126998 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:27.126959 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" event={"ID":"10d1da4b-4aaa-4181-a5f1-61e565c9df78","Type":"ContainerStarted","Data":"5d14fcc6d2e6c7a15e64464764e52bcb09f74a223f46892fa5c589d0e8acbd9b"} Jun 13 02:16:27.143356 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:27.143309 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" podStartSLOduration=2.101139281 podStartE2EDuration="57.143296639s" totalImagesPullingTime="163.297606ms" totalInitContainerRuntime="54.878859752s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:16:27.14280557 +0000 UTC m=+953.090490486" watchObservedRunningTime="2026-06-13 02:16:27.143296639 +0000 UTC m=+953.090981559" Jun 13 02:16:30.450056 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:30.450019 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:16:30.450567 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:30.450090 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:16:30.462494 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:30.462467 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:16:31.155638 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:31.155607 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c92xz" Jun 13 02:16:32.494212 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.494179 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79f888c9bd-7nl9j"] Jun 13 02:16:32.498023 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.498005 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.506769 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.506748 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79f888c9bd-7nl9j"] Jun 13 02:16:32.579471 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.579440 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/177b2acd-c6cd-45eb-bdab-470779ab5d0e-tls-cert\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.579471 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.579474 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xkg\" (UniqueName: \"kubernetes.io/projected/177b2acd-c6cd-45eb-bdab-470779ab5d0e-kube-api-access-s5xkg\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.579689 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.579516 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/177b2acd-c6cd-45eb-bdab-470779ab5d0e-oidc-ca\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.680329 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.680287 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/177b2acd-c6cd-45eb-bdab-470779ab5d0e-tls-cert\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.680329 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.680327 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xkg\" (UniqueName: \"kubernetes.io/projected/177b2acd-c6cd-45eb-bdab-470779ab5d0e-kube-api-access-s5xkg\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.680526 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.680365 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/177b2acd-c6cd-45eb-bdab-470779ab5d0e-oidc-ca\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.681025 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.681003 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/177b2acd-c6cd-45eb-bdab-470779ab5d0e-oidc-ca\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.682648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.682625 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/177b2acd-c6cd-45eb-bdab-470779ab5d0e-tls-cert\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.687907 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.687889 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xkg\" (UniqueName: \"kubernetes.io/projected/177b2acd-c6cd-45eb-bdab-470779ab5d0e-kube-api-access-s5xkg\") pod \"authorino-79f888c9bd-7nl9j\" (UID: \"177b2acd-c6cd-45eb-bdab-470779ab5d0e\") " pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.806901 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.806830 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79f888c9bd-7nl9j" Jun 13 02:16:32.930963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:32.930938 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79f888c9bd-7nl9j"] Jun 13 02:16:32.934753 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:16:32.934722 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod177b2acd_c6cd_45eb_bdab_470779ab5d0e.slice/crio-75f17eaa79db270719556958d088c766ab0208efa92e901b674558a78d7263c7 WatchSource:0}: Error finding container 75f17eaa79db270719556958d088c766ab0208efa92e901b674558a78d7263c7: Status 404 returned error can't find the container with id 75f17eaa79db270719556958d088c766ab0208efa92e901b674558a78d7263c7 Jun 13 02:16:33.153667 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:33.153579 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79f888c9bd-7nl9j" event={"ID":"177b2acd-c6cd-45eb-bdab-470779ab5d0e","Type":"ContainerStarted","Data":"75f17eaa79db270719556958d088c766ab0208efa92e901b674558a78d7263c7"} Jun 13 02:16:34.159963 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.159919 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79f888c9bd-7nl9j" event={"ID":"177b2acd-c6cd-45eb-bdab-470779ab5d0e","Type":"ContainerStarted","Data":"b62b44fb25719820b4ebdc41c8d2ab382f5cdc08d5348ebb275f276accc29036"} Jun 13 02:16:34.176211 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.176152 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79f888c9bd-7nl9j" podStartSLOduration=1.791849349 podStartE2EDuration="2.176128295s" totalImagesPullingTime="384.278946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:16:34.174661024 +0000 UTC m=+960.122345946" watchObservedRunningTime="2026-06-13 02:16:34.176128295 +0000 UTC m=+960.123813215" Jun 13 02:16:34.203804 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.203636 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c948cc67c-5xn6w"] Jun 13 02:16:34.203967 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.203878 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" podUID="b61b5e49-cbd8-4e90-a329-44787ed086f6" containerName="authorino" containerID="cri-o://3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed" gracePeriod=30 Jun 13 02:16:34.461404 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.461375 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:16:34.497617 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.497582 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b61b5e49-cbd8-4e90-a329-44787ed086f6-oidc-ca\") pod \"b61b5e49-cbd8-4e90-a329-44787ed086f6\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " Jun 13 02:16:34.497805 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.497706 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxn7n\" (UniqueName: \"kubernetes.io/projected/b61b5e49-cbd8-4e90-a329-44787ed086f6-kube-api-access-jxn7n\") pod \"b61b5e49-cbd8-4e90-a329-44787ed086f6\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " Jun 13 02:16:34.497805 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.497769 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61b5e49-cbd8-4e90-a329-44787ed086f6-tls-cert\") pod \"b61b5e49-cbd8-4e90-a329-44787ed086f6\" (UID: \"b61b5e49-cbd8-4e90-a329-44787ed086f6\") " Jun 13 02:16:34.500443 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.500411 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61b5e49-cbd8-4e90-a329-44787ed086f6-kube-api-access-jxn7n" (OuterVolumeSpecName: "kube-api-access-jxn7n") pod "b61b5e49-cbd8-4e90-a329-44787ed086f6" (UID: "b61b5e49-cbd8-4e90-a329-44787ed086f6"). InnerVolumeSpecName "kube-api-access-jxn7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:16:34.503438 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.503411 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b61b5e49-cbd8-4e90-a329-44787ed086f6-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b61b5e49-cbd8-4e90-a329-44787ed086f6" (UID: "b61b5e49-cbd8-4e90-a329-44787ed086f6"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:16:34.507695 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.507661 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b61b5e49-cbd8-4e90-a329-44787ed086f6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b61b5e49-cbd8-4e90-a329-44787ed086f6" (UID: "b61b5e49-cbd8-4e90-a329-44787ed086f6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:16:34.598572 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.598538 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxn7n\" (UniqueName: \"kubernetes.io/projected/b61b5e49-cbd8-4e90-a329-44787ed086f6-kube-api-access-jxn7n\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:16:34.598572 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.598575 2546 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b61b5e49-cbd8-4e90-a329-44787ed086f6-tls-cert\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:16:34.598865 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.598592 2546 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b61b5e49-cbd8-4e90-a329-44787ed086f6-oidc-ca\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:16:34.822710 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:34.822676 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:16:35.166090 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.166053 2546 generic.go:356] "Generic (PLEG): container finished" podID="b61b5e49-cbd8-4e90-a329-44787ed086f6" containerID="3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed" exitCode=0 Jun 13 02:16:35.166537 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.166099 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" Jun 13 02:16:35.166537 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.166133 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" event={"ID":"b61b5e49-cbd8-4e90-a329-44787ed086f6","Type":"ContainerDied","Data":"3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed"} Jun 13 02:16:35.166537 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.166170 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c948cc67c-5xn6w" event={"ID":"b61b5e49-cbd8-4e90-a329-44787ed086f6","Type":"ContainerDied","Data":"391168a1b1031b1a88da6d8d54cdb9158b1ae8a9528bf37cebe7bd27db7162e5"} Jun 13 02:16:35.166537 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.166188 2546 scope.go:117] "RemoveContainer" containerID="3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed" Jun 13 02:16:35.174905 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.174886 2546 scope.go:117] "RemoveContainer" containerID="3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed" Jun 13 02:16:35.175176 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:16:35.175159 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed\": container with ID starting with 3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed not found: ID does not exist" containerID="3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed" Jun 13 02:16:35.175235 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.175184 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed"} err="failed to get container status \"3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed\": rpc error: code = NotFound desc = could not find container \"3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed\": container with ID starting with 3a8cda74147e0c6a2a257f569640655e8fb3e34503019f0c081605b4c53755ed not found: ID does not exist" Jun 13 02:16:35.186386 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.186356 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c948cc67c-5xn6w"] Jun 13 02:16:35.187973 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.187951 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c948cc67c-5xn6w"] Jun 13 02:16:35.776914 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.776879 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:16:35.907625 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:35.907583 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:16:36.007567 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:36.007531 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:16:36.396316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:36.396284 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b61b5e49-cbd8-4e90-a329-44787ed086f6" path="/var/lib/kubelet/pods/b61b5e49-cbd8-4e90-a329-44787ed086f6/volumes" Jun 13 02:16:38.001059 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:38.001024 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:16:38.053483 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:16:38.053454 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:17:05.711355 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:17:05.711253 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:17:15.496051 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:17:15.496017 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:17:24.989820 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:17:24.989769 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:17:34.983914 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:17:34.983875 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:17:44.092018 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:17:44.091981 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:17:54.586273 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:17:54.586238 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:18:02.231873 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:02.231837 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:04.068180 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:04.068147 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:27.282584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:27.282494 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:18:32.482899 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:32.482864 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:18:46.098896 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:46.098859 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:46.198726 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:46.198694 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:46.344215 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:46.344180 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:46.853590 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:46.853549 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:46.953334 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:46.953302 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:18:54.587231 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:18:54.587201 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:00.255652 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:00.255619 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:00.307584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:00.307554 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:09.787698 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:09.787659 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:19:25.782028 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:25.781983 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:19:32.491945 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:32.491899 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:32.590235 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:32.590205 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:32.690038 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:32.690007 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:33.243882 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:33.243848 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:33.345194 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:33.345164 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:19:56.465974 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:19:56.465891 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:02.106581 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:02.106545 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:02.156640 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:02.156609 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:02.242635 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:02.242602 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:02.339557 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:02.339525 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:02.468131 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:02.468042 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:02.567950 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:02.567916 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:04.190064 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:04.190027 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:20:19.112519 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:19.112481 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:19.213843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:19.213812 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:19.320383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:19.320346 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:20.484946 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:20.484913 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:20:24.921580 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:24.921546 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:25.025046 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:25.025005 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:33.059412 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:33.059369 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:33.159894 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:33.159850 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:33.262215 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:33.262181 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:33.365535 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:33.365454 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:34.584669 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:34.584639 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:20:49.795063 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:49.795000 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:49.903817 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:49.903770 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:49.988731 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:49.988699 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:20:50.012114 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:50.012081 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:53.587886 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:53.587850 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:20:55.816130 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:55.816094 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:20:55.916104 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:20:55.916070 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:12.056137 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:12.056107 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:12.158969 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:12.158937 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:12.283211 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:12.283175 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:18.249764 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:18.249693 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:18.304291 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:18.304259 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:18.377922 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:18.377882 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:18.473192 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:18.473160 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:18.586464 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:18.586380 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:24.326459 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:24.326421 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:24.381310 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:24.381274 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:26.031269 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:26.031233 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:26.131220 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:26.131188 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:21:50.689920 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:50.689883 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:21:59.581101 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:21:59.581064 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:22:16.486442 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:22:16.486406 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:22:24.788991 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:22:24.788957 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:22:42.287966 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:22:42.287924 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:22:50.790678 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:22:50.790599 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:23:23.383843 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:23.383809 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:23:23.899377 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:23.899344 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:23:24.714630 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:24.714601 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:23:32.182459 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:32.182423 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:23:39.983168 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:39.983122 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:23:48.291005 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:48.290967 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:23:56.782183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:23:56.782146 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:24:22.286535 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:24:22.286452 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:24:36.282324 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:24:36.282286 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:25:23.086855 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:25:23.086822 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:25:30.781097 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:25:30.781062 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:25:49.883311 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:25:49.883216 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:25:54.992983 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:25:54.992940 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:25:58.387403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:25:58.387367 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:07.392185 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:07.392139 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:16.291176 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:16.291136 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:25.001294 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:25.001255 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:33.784550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:33.784513 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:42.485119 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:42.485081 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:50.887281 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:50.887241 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:26:59.091605 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:26:59.091560 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:27:07.480883 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:27:07.480843 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:27:53.285834 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:27:53.285732 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:29:29.330331 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:29:29.330294 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:29:34.028847 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:29:34.028806 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:29:59.230829 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:29:59.230774 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:30:03.931060 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:03.931016 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:30:11.128914 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:11.128877 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:30:11.605453 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:11.605414 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:30:21.724845 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:21.724811 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:30:30.437353 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:30.437317 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:30:41.526330 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:41.526296 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:30:50.031452 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:30:50.031415 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:31:00.324088 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:31:00.324050 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:31:09.431873 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:31:09.431835 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:31:20.023137 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:31:20.023070 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:31:29.029095 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:31:29.029060 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:31:33.826325 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:31:33.826288 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:32:02.025560 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:32:02.025466 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:32:44.831309 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:32:44.831265 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:32:53.226405 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:32:53.226366 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:02.034898 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:02.034859 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:10.329273 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:10.329235 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:19.334076 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:19.333979 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:31.833962 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:31.833922 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:40.740811 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:40.740756 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:46.333059 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:46.333026 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:33:53.137289 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:33:53.137251 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:34:01.831312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:34:01.831273 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:34:09.625634 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:34:09.625600 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:34:20.033056 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:34:20.033021 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:34:38.087335 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:34:38.087297 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:34:46.925179 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:34:46.925137 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:34:55.239281 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:34:55.239174 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:35:03.086880 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:03.086838 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:35:20.736222 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:20.736182 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:35:28.938121 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:28.938082 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:35:34.812792 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:34.812755 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:35:38.031883 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:38.031840 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:35:46.726318 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:46.726282 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:35:55.237996 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:35:55.237961 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:04.024978 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:04.024945 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:12.630266 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:12.630222 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:23.532760 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:23.532679 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:33.032066 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:33.032031 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:43.828235 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:43.828199 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:53.064856 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:53.064824 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:36:58.145137 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:36:58.145098 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:37:05.432547 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:05.432509 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:37:10.936048 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:10.936009 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:37:25.548902 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:25.548862 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:37:34.126034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:34.125996 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:37:42.072861 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:42.072824 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:37:43.437533 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:43.437493 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:37:45.376584 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:45.376550 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:37:49.138375 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:37:49.138292 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:09.633583 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:09.633547 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:10.628340 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:10.628304 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:22.694950 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:22.694911 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:23.828842 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:23.828805 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:24.289019 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.288987 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr"] Jun 13 02:38:24.289343 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.289328 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b61b5e49-cbd8-4e90-a329-44787ed086f6" containerName="authorino" Jun 13 02:38:24.289447 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.289345 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61b5e49-cbd8-4e90-a329-44787ed086f6" containerName="authorino" Jun 13 02:38:24.289447 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.289407 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b61b5e49-cbd8-4e90-a329-44787ed086f6" containerName="authorino" Jun 13 02:38:24.292455 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.292430 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.295562 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.295536 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c06ab60e-openshift-default-dockercfg-988dl\"" Jun 13 02:38:24.315131 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.315106 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr"] Jun 13 02:38:24.322004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.321977 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:24.409223 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409185 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-credential-socket\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409242 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jgh\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-kube-api-access-78jgh\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409290 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-token\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409319 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-certs\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409339 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-envoy\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409355 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istiod-ca-cert\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409403 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409399 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-socket\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409668 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409456 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-data\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.409668 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.409480 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-podinfo\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.425114 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.425082 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:24.510988 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.510956 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-socket\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511103 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-data\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511183 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511129 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-podinfo\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511182 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-credential-socket\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511218 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jgh\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-kube-api-access-78jgh\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511247 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-token\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511277 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-certs\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511316 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511301 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-envoy\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511597 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511324 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istiod-ca-cert\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511597 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511408 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-socket\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.511597 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.511484 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-data\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.512028 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.512002 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-credential-socket\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.512160 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.512043 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istiod-ca-cert\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.512437 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.512410 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-certs\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.513952 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.513930 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-envoy\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.514212 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.514191 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-podinfo\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.519542 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.519518 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-token\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.520250 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.520233 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jgh\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-kube-api-access-78jgh\") pod \"e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.522123 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.522085 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:24.603856 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.603751 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:24.621640 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.621605 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:24.761705 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.761679 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr"] Jun 13 02:38:24.763529 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:38:24.763502 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc60c51_946c_4fb9_a56c_03f0c937bc0f.slice/crio-88b957944f9cf9921410303aea92bde217a333f7c084b57a743415a24ed41ff9 WatchSource:0}: Error finding container 88b957944f9cf9921410303aea92bde217a333f7c084b57a743415a24ed41ff9: Status 404 returned error can't find the container with id 88b957944f9cf9921410303aea92bde217a333f7c084b57a743415a24ed41ff9 Jun 13 02:38:24.766347 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.766310 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:38:24.766426 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.766395 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:38:24.766465 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.766436 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:38:24.827511 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.827485 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:24.836274 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.836248 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" event={"ID":"6cc60c51-946c-4fb9-a56c-03f0c937bc0f","Type":"ContainerStarted","Data":"e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0"} Jun 13 02:38:24.836578 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.836299 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" event={"ID":"6cc60c51-946c-4fb9-a56c-03f0c937bc0f","Type":"ContainerStarted","Data":"88b957944f9cf9921410303aea92bde217a333f7c084b57a743415a24ed41ff9"} Jun 13 02:38:24.855675 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:24.855599 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" podStartSLOduration=0.855584143 podStartE2EDuration="855.584143ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:38:24.853913802 +0000 UTC m=+2270.801598725" watchObservedRunningTime="2026-06-13 02:38:24.855584143 +0000 UTC m=+2270.803269062" Jun 13 02:38:25.271110 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.271078 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:25.370886 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.370853 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:25.604550 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.604466 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:25.609222 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.609201 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:25.679566 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.679534 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:25.840420 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.840389 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:25.841373 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:25.841345 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:26.058312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:26.058279 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:26.162845 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:26.162744 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:26.264046 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:26.264015 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:26.543323 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:26.543288 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:26.880808 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:26.880711 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:26.981310 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:26.981275 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:27.259366 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:27.259331 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:27.409417 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:27.409379 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:27.590480 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:27.590398 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:27.691044 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:27.691014 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:27.878330 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:27.878245 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:28.474932 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:28.474895 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:29.073570 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:29.073535 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:29.749135 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:29.749064 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:30.226910 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:30.226822 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:30.571796 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:30.571749 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:30.739112 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:30.739067 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr"] Jun 13 02:38:30.739333 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:30.739306 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" podUID="6cc60c51-946c-4fb9-a56c-03f0c937bc0f" containerName="istio-proxy" containerID="cri-o://e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0" gracePeriod=30 Jun 13 02:38:30.755401 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:30.755375 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:30.856366 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:30.856280 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:32.120919 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:32.120889 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:33.024378 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:33.024340 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:35.592184 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.592160 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:35.605020 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.604974 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-socket\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605020 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605015 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-certs\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605035 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-podinfo\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605085 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78jgh\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-kube-api-access-78jgh\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605110 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-token\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605135 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istiod-ca-cert\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605371 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605273 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:35.605371 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605281 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-credential-socket\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605371 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605337 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-envoy\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605521 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605423 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-data\") pod \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\" (UID: \"6cc60c51-946c-4fb9-a56c-03f0c937bc0f\") " Jun 13 02:38:35.605521 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605293 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:35.605521 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605480 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:38:35.605667 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605574 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:35.605753 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605735 2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istiod-ca-cert\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.605823 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605756 2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-credential-socket\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.605823 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605771 2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-socket\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.605823 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.605799 2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-workload-certs\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.606343 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.606313 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:35.607453 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.607428 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 02:38:35.607453 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.607441 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-kube-api-access-78jgh" (OuterVolumeSpecName: "kube-api-access-78jgh") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "kube-api-access-78jgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:38:35.607577 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.607479 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:35.607577 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.607526 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cc60c51-946c-4fb9-a56c-03f0c937bc0f" (UID: "6cc60c51-946c-4fb9-a56c-03f0c937bc0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:38:35.706225 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.706193 2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-podinfo\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.706225 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.706220 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78jgh\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-kube-api-access-78jgh\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.706225 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.706231 2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-token\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.706438 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.706240 2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-envoy\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.706438 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.706247 2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cc60c51-946c-4fb9-a56c-03f0c937bc0f-istio-data\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:35.887796 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.887683 2546 generic.go:356] "Generic (PLEG): container finished" podID="6cc60c51-946c-4fb9-a56c-03f0c937bc0f" containerID="e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0" exitCode=0 Jun 13 02:38:35.887796 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.887728 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" Jun 13 02:38:35.887796 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.887744 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" event={"ID":"6cc60c51-946c-4fb9-a56c-03f0c937bc0f","Type":"ContainerDied","Data":"e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0"} Jun 13 02:38:35.888035 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.887813 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr" event={"ID":"6cc60c51-946c-4fb9-a56c-03f0c937bc0f","Type":"ContainerDied","Data":"88b957944f9cf9921410303aea92bde217a333f7c084b57a743415a24ed41ff9"} Jun 13 02:38:35.888035 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.887836 2546 scope.go:117] "RemoveContainer" containerID="e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0" Jun 13 02:38:35.897114 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.897097 2546 scope.go:117] "RemoveContainer" containerID="e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0" Jun 13 02:38:35.897351 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:38:35.897333 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0\": container with ID starting with e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0 not found: ID does not exist" containerID="e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0" Jun 13 02:38:35.897399 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.897358 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0"} err="failed to get container status \"e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0\": rpc error: code = NotFound desc = could not find container \"e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0\": container with ID starting with e17a026c4e41fadac3cd0dff6ff14ede99e4651e2ce3019958512bfafb6c2cc0 not found: ID does not exist" Jun 13 02:38:35.909075 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.909055 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr"] Jun 13 02:38:35.913769 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:35.913750 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c06ab60e-openshift-default-756f9c54d8-db4nr"] Jun 13 02:38:36.396593 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.396564 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc60c51-946c-4fb9-a56c-03f0c937bc0f" path="/var/lib/kubelet/pods/6cc60c51-946c-4fb9-a56c-03f0c937bc0f/volumes" Jun 13 02:38:36.504583 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.504548 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:36.563052 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.563021 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:36.674093 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.674009 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9"] Jun 13 02:38:36.674465 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.674328 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc60c51-946c-4fb9-a56c-03f0c937bc0f" containerName="istio-proxy" Jun 13 02:38:36.674465 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.674339 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc60c51-946c-4fb9-a56c-03f0c937bc0f" containerName="istio-proxy" Jun 13 02:38:36.674465 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.674396 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc60c51-946c-4fb9-a56c-03f0c937bc0f" containerName="istio-proxy" Jun 13 02:38:36.678610 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.678583 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.684321 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.684297 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-17aed310-openshift-default-dockercfg-ncvcg\"" Jun 13 02:38:36.694673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.694650 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9"] Jun 13 02:38:36.712242 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712219 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-token\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712354 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712246 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdckl\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-kube-api-access-cdckl\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712354 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712273 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-certs\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712354 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712296 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-podinfo\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712354 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712324 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-credential-socket\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712515 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712364 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-socket\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712515 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712406 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-data\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712515 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712477 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-envoy\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.712515 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.712492 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128bf5dc-e1ed-439a-9a52-c253af35067c-istiod-ca-cert\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.718197 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.718178 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:36.813545 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813510 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-socket\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813545 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813551 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-data\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813595 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-envoy\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813610 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128bf5dc-e1ed-439a-9a52-c253af35067c-istiod-ca-cert\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813638 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-token\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813657 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdckl\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-kube-api-access-cdckl\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813684 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-certs\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813713 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-podinfo\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.813798 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813745 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-credential-socket\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.814170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.813972 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-socket\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.814170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.814035 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-data\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.814170 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.814128 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-certs\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.814341 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.814175 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-credential-socket\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.814396 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.814379 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128bf5dc-e1ed-439a-9a52-c253af35067c-istiod-ca-cert\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.815433 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.815405 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:36.816297 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.816277 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-podinfo\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.816383 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.816371 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-envoy\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.825693 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.825656 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-token\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.825841 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.825737 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdckl\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-kube-api-access-cdckl\") pod \"e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:36.916137 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.916099 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:36.989160 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:36.989127 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:37.019855 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.019814 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.121165 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.121129 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9"] Jun 13 02:38:37.123004 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:38:37.122975 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128bf5dc_e1ed_439a_9a52_c253af35067c.slice/crio-fb3e1222eccc29089b513c967dd97bd0ed9af2859aa6cbade22f320f7b99aea7 WatchSource:0}: Error finding container fb3e1222eccc29089b513c967dd97bd0ed9af2859aa6cbade22f320f7b99aea7: Status 404 returned error can't find the container with id fb3e1222eccc29089b513c967dd97bd0ed9af2859aa6cbade22f320f7b99aea7 Jun 13 02:38:37.125648 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.125602 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:38:37.125759 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.125700 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:38:37.125759 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.125748 2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 13 02:38:37.214617 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.214585 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.381829 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.381729 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.482355 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.482321 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.580641 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.580609 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.742796 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.742759 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.847091 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.847059 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:37.899335 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.899298 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" event={"ID":"128bf5dc-e1ed-439a-9a52-c253af35067c","Type":"ContainerStarted","Data":"8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9"} Jun 13 02:38:37.899530 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.899387 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" event={"ID":"128bf5dc-e1ed-439a-9a52-c253af35067c","Type":"ContainerStarted","Data":"fb3e1222eccc29089b513c967dd97bd0ed9af2859aa6cbade22f320f7b99aea7"} Jun 13 02:38:37.918994 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.918941 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" podStartSLOduration=1.918925151 podStartE2EDuration="1.918925151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:38:37.916734197 +0000 UTC m=+2283.864419152" watchObservedRunningTime="2026-06-13 02:38:37.918925151 +0000 UTC m=+2283.866610072" Jun 13 02:38:37.989621 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:37.989578 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:38.328461 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:38.328424 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:38.930396 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:38.930365 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:38.994530 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:38.994498 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:39.751410 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:39.751384 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:39.868894 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:39.868865 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:39.908869 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:39.908836 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:39.909889 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:39.909870 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:40.550147 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:40.550115 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:40.808513 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:40.808423 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:40.924633 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:40.924602 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:41.330034 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:41.330003 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:42.960312 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:42.960277 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:44.098222 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:44.098184 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9"] Jun 13 02:38:44.098699 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:44.098449 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" podUID="128bf5dc-e1ed-439a-9a52-c253af35067c" containerName="istio-proxy" containerID="cri-o://8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9" gracePeriod=30 Jun 13 02:38:44.124549 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:44.124517 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:44.219196 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:44.219157 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:45.123722 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:45.123688 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jxttc"] Jun 13 02:38:46.487196 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:46.487164 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:48.553864 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.553812 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:48.614535 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614505 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-envoy\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614559 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-credential-socket\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614576 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-socket\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614601 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdckl\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-kube-api-access-cdckl\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614673 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614624 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-certs\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614875 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614692 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-podinfo\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614875 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614716 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128bf5dc-e1ed-439a-9a52-c253af35067c-istiod-ca-cert\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614875 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614750 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-token\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.614875 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614803 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-data\") pod \"128bf5dc-e1ed-439a-9a52-c253af35067c\" (UID: \"128bf5dc-e1ed-439a-9a52-c253af35067c\") " Jun 13 02:38:48.615076 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614871 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:48.615076 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.614988 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:48.615192 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.615074 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:48.615192 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.615125 2546 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-credential-socket\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.615192 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.615153 2546 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-socket\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.615456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.615434 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/128bf5dc-e1ed-439a-9a52-c253af35067c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:38:48.615831 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.615808 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-data" (OuterVolumeSpecName: "istio-data") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:48.616795 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.616762 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-kube-api-access-cdckl" (OuterVolumeSpecName: "kube-api-access-cdckl") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "kube-api-access-cdckl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:38:48.617014 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.616994 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 02:38:48.617147 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.617122 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:38:48.617242 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.617159 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-token" (OuterVolumeSpecName: "istio-token") pod "128bf5dc-e1ed-439a-9a52-c253af35067c" (UID: "128bf5dc-e1ed-439a-9a52-c253af35067c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715888 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdckl\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-kube-api-access-cdckl\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715919 2546 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-workload-certs\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715929 2546 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-podinfo\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715938 2546 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128bf5dc-e1ed-439a-9a52-c253af35067c-istiod-ca-cert\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715947 2546 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-token\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715955 2546 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-data\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.715972 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.715963 2546 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128bf5dc-e1ed-439a-9a52-c253af35067c-istio-envoy\") on node \"ip-10-0-134-133.ec2.internal\" DevicePath \"\"" Jun 13 02:38:48.957392 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.957357 2546 generic.go:356] "Generic (PLEG): container finished" podID="128bf5dc-e1ed-439a-9a52-c253af35067c" containerID="8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9" exitCode=0 Jun 13 02:38:48.957565 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.957397 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" event={"ID":"128bf5dc-e1ed-439a-9a52-c253af35067c","Type":"ContainerDied","Data":"8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9"} Jun 13 02:38:48.957565 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.957412 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" Jun 13 02:38:48.957565 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.957452 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9" event={"ID":"128bf5dc-e1ed-439a-9a52-c253af35067c","Type":"ContainerDied","Data":"fb3e1222eccc29089b513c967dd97bd0ed9af2859aa6cbade22f320f7b99aea7"} Jun 13 02:38:48.957565 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.957483 2546 scope.go:117] "RemoveContainer" containerID="8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9" Jun 13 02:38:48.966098 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.966084 2546 scope.go:117] "RemoveContainer" containerID="8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9" Jun 13 02:38:48.966344 ip-10-0-134-133 kubenswrapper[2546]: E0613 02:38:48.966324 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9\": container with ID starting with 8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9 not found: ID does not exist" containerID="8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9" Jun 13 02:38:48.966407 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.966352 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9"} err="failed to get container status \"8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9\": rpc error: code = NotFound desc = could not find container \"8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9\": container with ID starting with 8c6ee806b3ee014f1a5ce1a3e2ab85572ab86b00b44f1812604c8867aa4a40d9 not found: ID does not exist" Jun 13 02:38:48.978980 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.978956 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9"] Jun 13 02:38:48.982111 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:48.982089 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-17aed310-openshift-default-55c564c8f8-2khv9"] Jun 13 02:38:50.073011 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:50.072958 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:50.171587 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:50.171529 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:38:50.396544 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:50.396466 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="128bf5dc-e1ed-439a-9a52-c253af35067c" path="/var/lib/kubelet/pods/128bf5dc-e1ed-439a-9a52-c253af35067c/volumes" Jun 13 02:38:56.360827 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:38:56.360772 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79f888c9bd-7nl9j_177b2acd-c6cd-45eb-bdab-470779ab5d0e/authorino/0.log" Jun 13 02:39:00.854891 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:00.854856 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8459cf648c-gj7mc_61f02555-7ddb-4d30-a7d0-082a7c208302/nginx/0.log" Jun 13 02:39:02.294759 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:02.294729 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-s5q5s_faa66887-7602-4fe2-ae76-fb235335c4ca/copy-manifests/0.log" Jun 13 02:39:02.307291 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:02.307263 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-s5q5s_faa66887-7602-4fe2-ae76-fb235335c4ca/manager/0.log" Jun 13 02:39:03.905957 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:03.905923 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79f888c9bd-7nl9j_177b2acd-c6cd-45eb-bdab-470779ab5d0e/authorino/0.log" Jun 13 02:39:04.028568 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:04.028530 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gdflp_8775a8a9-31ed-46ee-a092-64329aa4ff25/manager/0.log" Jun 13 02:39:04.252144 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:04.252119 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vs58m_2ca25a7d-1f08-4d53-9380-96fd2f2f4239/kuadrant-console-plugin/0.log" Jun 13 02:39:04.376300 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:04.376265 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rqlc2_653f6be8-e6b6-40ea-9676-27d5cbf8b1cb/registry-server/0.log" Jun 13 02:39:04.628534 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:04.628428 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jxttc_c6b35d57-7478-4b81-9025-ee4818e6024e/limitador/0.log" Jun 13 02:39:05.086644 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:05.086613 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795dfq54_702bedec-ddd2-4186-9d50-eb6a0c23a777/istio-proxy/0.log" Jun 13 02:39:05.547854 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:05.547804 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/1.log" Jun 13 02:39:06.342135 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:06.342080 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-pllnl_d883e185-2a29-489d-b4fb-4e6b4954a2ec/storage-initializer/0.log" Jun 13 02:39:06.349115 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:06.349089 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-pllnl_d883e185-2a29-489d-b4fb-4e6b4954a2ec/main/0.log" Jun 13 02:39:06.692246 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:06.692149 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn_cacfd20b-08cb-47e7-9f22-65f8763bbabb/storage-initializer/0.log" Jun 13 02:39:06.699293 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:06.699269 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-wvmbn_cacfd20b-08cb-47e7-9f22-65f8763bbabb/main/0.log" Jun 13 02:39:06.810494 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:06.810465 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-c92xz_10d1da4b-4aaa-4181-a5f1-61e565c9df78/storage-initializer/0.log" Jun 13 02:39:06.817697 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:06.817676 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-c92xz_10d1da4b-4aaa-4181-a5f1-61e565c9df78/main/0.log" Jun 13 02:39:10.449199 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.449166 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc5tz/must-gather-kmsdv"] Jun 13 02:39:10.449570 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.449513 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128bf5dc-e1ed-439a-9a52-c253af35067c" containerName="istio-proxy" Jun 13 02:39:10.449570 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.449529 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="128bf5dc-e1ed-439a-9a52-c253af35067c" containerName="istio-proxy" Jun 13 02:39:10.449644 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.449620 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="128bf5dc-e1ed-439a-9a52-c253af35067c" containerName="istio-proxy" Jun 13 02:39:10.452819 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.452803 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.455401 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.455379 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc5tz\"/\"openshift-service-ca.crt\"" Jun 13 02:39:10.455538 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.455379 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc5tz\"/\"kube-root-ca.crt\"" Jun 13 02:39:10.456282 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.456266 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bc5tz\"/\"default-dockercfg-hn2ct\"" Jun 13 02:39:10.460579 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.460540 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/must-gather-kmsdv"] Jun 13 02:39:10.462164 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.462136 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:39:10.559449 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.559418 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" limit=1024 Jun 13 02:39:10.611890 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.611860 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9140c9aa-427b-4c1d-980c-575b3c8fb8ca-must-gather-output\") pod \"must-gather-kmsdv\" (UID: \"9140c9aa-427b-4c1d-980c-575b3c8fb8ca\") " pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.612046 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.611914 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46dh\" (UniqueName: \"kubernetes.io/projected/9140c9aa-427b-4c1d-980c-575b3c8fb8ca-kube-api-access-k46dh\") pod \"must-gather-kmsdv\" (UID: \"9140c9aa-427b-4c1d-980c-575b3c8fb8ca\") " pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.712529 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.712443 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k46dh\" (UniqueName: \"kubernetes.io/projected/9140c9aa-427b-4c1d-980c-575b3c8fb8ca-kube-api-access-k46dh\") pod \"must-gather-kmsdv\" (UID: \"9140c9aa-427b-4c1d-980c-575b3c8fb8ca\") " pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.712529 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.712503 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9140c9aa-427b-4c1d-980c-575b3c8fb8ca-must-gather-output\") pod \"must-gather-kmsdv\" (UID: \"9140c9aa-427b-4c1d-980c-575b3c8fb8ca\") " pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.712820 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.712806 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9140c9aa-427b-4c1d-980c-575b3c8fb8ca-must-gather-output\") pod \"must-gather-kmsdv\" (UID: \"9140c9aa-427b-4c1d-980c-575b3c8fb8ca\") " pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.720130 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.720108 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46dh\" (UniqueName: \"kubernetes.io/projected/9140c9aa-427b-4c1d-980c-575b3c8fb8ca-kube-api-access-k46dh\") pod \"must-gather-kmsdv\" (UID: \"9140c9aa-427b-4c1d-980c-575b3c8fb8ca\") " pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.763897 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.763868 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/must-gather-kmsdv" Jun 13 02:39:10.895310 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.895159 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/must-gather-kmsdv"] Jun 13 02:39:10.897533 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:39:10.897504 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9140c9aa_427b_4c1d_980c_575b3c8fb8ca.slice/crio-442949fe3ed675fc972cf42c4d7a1ac8aecd90359708c0e47f7ee98a98cbdec5 WatchSource:0}: Error finding container 442949fe3ed675fc972cf42c4d7a1ac8aecd90359708c0e47f7ee98a98cbdec5: Status 404 returned error can't find the container with id 442949fe3ed675fc972cf42c4d7a1ac8aecd90359708c0e47f7ee98a98cbdec5 Jun 13 02:39:10.899319 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:10.899299 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:39:11.060873 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:11.060836 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/must-gather-kmsdv" event={"ID":"9140c9aa-427b-4c1d-980c-575b3c8fb8ca","Type":"ContainerStarted","Data":"442949fe3ed675fc972cf42c4d7a1ac8aecd90359708c0e47f7ee98a98cbdec5"} Jun 13 02:39:12.069020 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:12.068977 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/must-gather-kmsdv" event={"ID":"9140c9aa-427b-4c1d-980c-575b3c8fb8ca","Type":"ContainerStarted","Data":"c787cfb9a59f9b4307494458bc8a42caa7ec427a3106ef129ce6dc18c46f0043"} Jun 13 02:39:12.069512 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:12.069034 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/must-gather-kmsdv" event={"ID":"9140c9aa-427b-4c1d-980c-575b3c8fb8ca","Type":"ContainerStarted","Data":"d2570fd80bb64db5e661341aa10b2713387adebbe171fa2a7de3f13f4ae9fb71"} Jun 13 02:39:12.084757 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:12.084702 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bc5tz/must-gather-kmsdv" podStartSLOduration=1.332191345 podStartE2EDuration="2.084688108s" totalImagesPullingTime="752.496763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:39:12.083239469 +0000 UTC m=+2318.030924403" watchObservedRunningTime="2026-06-13 02:39:12.084688108 +0000 UTC m=+2318.032373006" Jun 13 02:39:13.291769 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:13.291708 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdj28_c1c9a1be-c2ac-4a44-b4ab-2bf413ea3d21/global-pull-secret-syncer/0.log" Jun 13 02:39:13.412867 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:13.412839 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pdlkg_80458c5c-996b-48d1-850c-309bfb6e44c4/konnectivity-agent/0.log" Jun 13 02:39:13.515500 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:13.515469 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-133.ec2.internal_97c5f5bba509447a5b7bb6659ffef353/haproxy/0.log" Jun 13 02:39:17.973108 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:17.973072 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79f888c9bd-7nl9j_177b2acd-c6cd-45eb-bdab-470779ab5d0e/authorino/0.log" Jun 13 02:39:18.001325 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:18.001296 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gdflp_8775a8a9-31ed-46ee-a092-64329aa4ff25/manager/0.log" Jun 13 02:39:18.114186 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:18.114157 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vs58m_2ca25a7d-1f08-4d53-9380-96fd2f2f4239/kuadrant-console-plugin/0.log" Jun 13 02:39:18.166725 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:18.166482 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rqlc2_653f6be8-e6b6-40ea-9676-27d5cbf8b1cb/registry-server/0.log" Jun 13 02:39:18.291367 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:18.291327 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jxttc_c6b35d57-7478-4b81-9025-ee4818e6024e/limitador/0.log" Jun 13 02:39:20.513066 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:20.513028 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8j78_bf2b9fbf-8193-4b25-a75a-dd516afe9879/node-exporter/0.log" Jun 13 02:39:20.532007 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:20.531977 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8j78_bf2b9fbf-8193-4b25-a75a-dd516afe9879/kube-rbac-proxy/0.log" Jun 13 02:39:20.551594 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:20.551559 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c8j78_bf2b9fbf-8193-4b25-a75a-dd516afe9879/init-textfile/0.log" Jun 13 02:39:25.315291 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.315258 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh"] Jun 13 02:39:25.321157 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.321130 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.328040 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.327892 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh"] Jun 13 02:39:25.370279 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.370248 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-sys\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.370478 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.370463 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-lib-modules\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.370568 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.370558 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-podres\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.370691 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.370682 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppd8\" (UniqueName: \"kubernetes.io/projected/e7ddd492-7154-4cf4-a376-86c914121edc-kube-api-access-dppd8\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.370762 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.370753 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-proc\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.472152 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.472116 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dppd8\" (UniqueName: \"kubernetes.io/projected/e7ddd492-7154-4cf4-a376-86c914121edc-kube-api-access-dppd8\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.472428 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.472408 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-proc\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.472597 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.472563 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-sys\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.472737 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.472722 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-lib-modules\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.472885 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.472871 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-podres\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.473191 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.473175 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-podres\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.473667 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.473646 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-proc\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.473860 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.473844 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-sys\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.474068 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.474035 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7ddd492-7154-4cf4-a376-86c914121edc-lib-modules\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.481757 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.481726 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dppd8\" (UniqueName: \"kubernetes.io/projected/e7ddd492-7154-4cf4-a376-86c914121edc-kube-api-access-dppd8\") pod \"perf-node-gather-daemonset-m4vdh\" (UID: \"e7ddd492-7154-4cf4-a376-86c914121edc\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.635577 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.635285 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:25.819737 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.819666 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh"] Jun 13 02:39:25.824390 ip-10-0-134-133 kubenswrapper[2546]: W0613 02:39:25.824329 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7ddd492_7154_4cf4_a376_86c914121edc.slice/crio-41b1f56e44896bede5cccbf35a1aa992b91ba2e5db21704e809eb41301f0ae2c WatchSource:0}: Error finding container 41b1f56e44896bede5cccbf35a1aa992b91ba2e5db21704e809eb41301f0ae2c: Status 404 returned error can't find the container with id 41b1f56e44896bede5cccbf35a1aa992b91ba2e5db21704e809eb41301f0ae2c Jun 13 02:39:25.950833 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.950765 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mfm6d_65a5d3e8-cb09-42a1-9431-5298d210dccf/dns/0.log" Jun 13 02:39:25.969616 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.969589 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mfm6d_65a5d3e8-cb09-42a1-9431-5298d210dccf/kube-rbac-proxy/0.log" Jun 13 02:39:25.990810 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:25.990766 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bhs2f_40eab1e5-112f-4d65-8fe3-6d5b2105d482/dns-node-resolver/0.log" Jun 13 02:39:26.161731 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:26.161693 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" event={"ID":"e7ddd492-7154-4cf4-a376-86c914121edc","Type":"ContainerStarted","Data":"7e69a60049a149ae858bae15008a6c0a9f7729b1420f04fd48b08ceed6d57b85"} Jun 13 02:39:26.161954 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:26.161753 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" event={"ID":"e7ddd492-7154-4cf4-a376-86c914121edc","Type":"ContainerStarted","Data":"41b1f56e44896bede5cccbf35a1aa992b91ba2e5db21704e809eb41301f0ae2c"} Jun 13 02:39:26.161954 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:26.161774 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:26.176993 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:26.176947 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" podStartSLOduration=1.176930065 podStartE2EDuration="1.176930065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:39:26.175995854 +0000 UTC m=+2332.123680784" watchObservedRunningTime="2026-06-13 02:39:26.176930065 +0000 UTC m=+2332.124614987" Jun 13 02:39:26.576674 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:26.576648 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbmxr_c95ab1a5-4d9e-4dcb-8147-5780720d018b/node-ca/0.log" Jun 13 02:39:27.445705 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:27.445676 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795dfq54_702bedec-ddd2-4186-9d50-eb6a0c23a777/istio-proxy/0.log" Jun 13 02:39:27.619758 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:27.619710 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/0.log" Jun 13 02:39:27.663729 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:27.663687 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/1.log" Jun 13 02:39:28.416366 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:28.416336 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r82jc_88f3e852-7672-494b-a76d-32aecbbea0da/serve-healthcheck-canary/0.log" Jun 13 02:39:28.938468 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:28.938422 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcnm8_f23bdb4a-d2e0-4cba-bd50-4f5a359a898d/kube-rbac-proxy/0.log" Jun 13 02:39:28.960294 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:28.960253 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcnm8_f23bdb4a-d2e0-4cba-bd50-4f5a359a898d/exporter/0.log" Jun 13 02:39:28.979537 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:28.979495 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcnm8_f23bdb4a-d2e0-4cba-bd50-4f5a359a898d/extractor/0.log" Jun 13 02:39:31.242423 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:31.242385 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8459cf648c-gj7mc_61f02555-7ddb-4d30-a7d0-082a7c208302/nginx/0.log" Jun 13 02:39:31.873600 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:31.873571 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-s5q5s_faa66887-7602-4fe2-ae76-fb235335c4ca/manager/0.log" Jun 13 02:39:31.889677 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:31.889651 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-s5q5s_faa66887-7602-4fe2-ae76-fb235335c4ca/copy-manifests/0.log" Jun 13 02:39:32.178807 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:32.178708 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-m4vdh" Jun 13 02:39:33.530185 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:33.530158 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54784dbd95-xm7f4_1f4929aa-e61e-46c9-8fef-8e90c925ce39/manager/0.log" Jun 13 02:39:37.934776 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:37.934739 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795dfq54_702bedec-ddd2-4186-9d50-eb6a0c23a777/istio-proxy/0.log" Jun 13 02:39:38.078519 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:38.078484 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/0.log" Jun 13 02:39:38.119762 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:38.119733 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/1.log" Jun 13 02:39:39.432002 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:39.431972 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795dfq54_702bedec-ddd2-4186-9d50-eb6a0c23a777/istio-proxy/0.log" Jun 13 02:39:39.589398 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:39.589372 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/0.log" Jun 13 02:39:39.630290 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:39.630255 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/1.log" Jun 13 02:39:40.426792 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.426743 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/kube-multus-additional-cni-plugins/0.log" Jun 13 02:39:40.446166 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.446141 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/egress-router-binary-copy/0.log" Jun 13 02:39:40.465726 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.465699 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/cni-plugins/0.log" Jun 13 02:39:40.484207 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.484183 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/bond-cni-plugin/0.log" Jun 13 02:39:40.503307 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.503285 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/routeoverride-cni/0.log" Jun 13 02:39:40.520940 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.520917 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/whereabouts-cni-bincopy/0.log" Jun 13 02:39:40.539196 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.539169 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbdwg_f9b3a324-b7d8-4bb7-a0a9-f3b756b70036/whereabouts-cni/0.log" Jun 13 02:39:40.729390 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.729360 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cpflc_b71c502b-12b0-4975-a99f-600702275bff/kube-multus/0.log" Jun 13 02:39:40.788159 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.788119 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dv4cc_7038fe64-fb84-4da4-8d82-0b5e6c1c609d/network-metrics-daemon/0.log" Jun 13 02:39:40.806511 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:40.806480 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dv4cc_7038fe64-fb84-4da4-8d82-0b5e6c1c609d/kube-rbac-proxy/0.log" Jun 13 02:39:41.239589 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:41.239557 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795dfq54_702bedec-ddd2-4186-9d50-eb6a0c23a777/istio-proxy/0.log" Jun 13 02:39:41.381743 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:41.381714 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/0.log" Jun 13 02:39:41.423949 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:41.423916 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-gll6v_381f2494-d962-428e-ac70-7789ec70352e/istio-proxy/1.log" Jun 13 02:39:42.244135 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.244109 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/ovn-controller/0.log" Jun 13 02:39:42.259875 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.259841 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/ovn-acl-logging/0.log" Jun 13 02:39:42.284446 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.284418 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/kube-rbac-proxy-node/0.log" Jun 13 02:39:42.304408 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.304383 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/kube-rbac-proxy-ovn-metrics/0.log" Jun 13 02:39:42.320004 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.319978 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/northd/0.log" Jun 13 02:39:42.339621 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.339591 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/nbdb/0.log" Jun 13 02:39:42.361456 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.361421 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/sbdb/0.log" Jun 13 02:39:42.409887 ip-10-0-134-133 kubenswrapper[2546]: I0613 02:39:42.409863 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rs9pf_055ab295-570e-41b1-93ae-df83f2cf7b42/ovnkube-controller/0.log"